-- Logs begin at Sun 2022-08-28 09:35:56 UTC, end at Sun 2022-08-28 10:37:57 UTC. -- Aug 28 10:07:21.194528 dv-cinder-852009-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 28 10:07:21.202182 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 28 10:07:21.204216 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 28 10:07:21 2022] *** Aug 28 10:07:21.204216 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 28 10:07:21.204216 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 28 10:07:21.204216 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: nodename: dv-cinder-852009-4-iscsi Aug 28 10:07:21.204216 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: machine: x86_64 Aug 28 10:07:21.204216 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: clock source: unix Aug 28 10:07:21.204216 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: pcre jit disabled Aug 28 10:07:21.204216 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: detected number of CPU cores: 4 Aug 28 10:07:21.204216 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: current working directory: / Aug 28 10:07:21.204216 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: detected binary path: /usr/bin/uwsgi-core Aug 28 10:07:21.204216 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: your processes number limit is 47680 Aug 28 10:07:21.204216 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: your memory page size is 4096 bytes Aug 28 10:07:21.204216 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: detected max file descriptor number: 2048 Aug 28 10:07:21.204216 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: lock engine: pthread robust mutexes Aug 28 10:07:21.205138 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: thunder lock: enabled Aug 28 10:07:21.206608 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 28 10:07:21.206608 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 28 10:07:21.243746 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: Python main interpreter initialized at 0x562ae2b589c0 Aug 28 10:07:21.243746 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: python threads support enabled Aug 28 10:07:21.243746 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: your server socket listen backlog is limited to 100 connections Aug 28 10:07:21.243746 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: your mercy for graceful operations on workers is 90 seconds Aug 28 10:07:21.244117 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: mapped 403077 bytes (393 KB) for 2 cores Aug 28 10:07:21.244243 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: *** Operational MODE: preforking *** Aug 28 10:07:21.244452 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: *** uWSGI is running in multiple interpreter mode *** Aug 28 10:07:21.244452 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: spawned uWSGI master process (pid: 105661) Aug 28 10:07:21.244655 dv-cinder-852009-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 28 10:07:21.245833 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: spawned uWSGI worker 1 (pid: 105662, cores: 1) Aug 28 10:07:21.246162 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: spawned uWSGI worker 2 (pid: 105663, cores: 1) Aug 28 10:07:21.246323 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 28 10:07:21.888478 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 28 10:07:21.889972 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 28 10:07:22.954087 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 10:07:22.954087 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: from cryptography.utils import int_from_bytes Aug 28 10:07:22.954704 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 10:07:22.954704 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: from cryptography.utils import int_from_bytes Aug 28 10:07:22.955102 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 10:07:22.955102 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: from cryptography.utils import int_from_bytes Aug 28 10:07:22.955265 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 10:07:22.955265 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: from cryptography.utils import int_from_bytes Aug 28 10:07:25.391628 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 28 10:07:25.392232 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 28 10:07:25.392338 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 28 10:07:25.392763 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 28 10:07:25.392966 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 28 10:07:25.393344 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.393670 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.393972 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.394277 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.394596 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.394896 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.395260 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.395571 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.395888 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.396140 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.396452 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.396791 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-4-iscsi {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.397100 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.397399 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.397699 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.398005 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.398301 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.398561 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 28 10:07:25.398937 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.399045 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 28 10:07:25.399127 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.399341 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 28 10:07:25.399433 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.399700 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 28 10:07:25.399796 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.399957 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 28 10:07:25.400085 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.400340 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.400469 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.400700 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.400821 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.401017 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.401131 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.401315 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.401402 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.401628 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.401727 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.401928 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.402017 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.402241 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.402336 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.402542 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.402649 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.402887 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.403027 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-4-iscsi {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.403111 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.403247 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.403421 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.403522 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.403740 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-4-iscsi {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.403842 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.404057 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.404210 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.404359 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.404526 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.404689 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.404837 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.405007 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.405146 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.405306 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.405457 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.405625 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.405756 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.405927 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.406095 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.406363 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.406450 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.406669 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.406758 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.406979 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.407069 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.407271 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.407358 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.407568 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.407670 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.407863 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.407960 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.408169 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.408266 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.408464 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.408585 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.408785 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.408873 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.409030 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.409196 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.409325 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.409500 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.409634 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.409895 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-4-iscsi {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.409995 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.410207 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.410306 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.410473 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.410572 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.410746 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.410870 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.411055 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.411204 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.411365 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.411511 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.411664 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.411814 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.411960 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.412128 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.412255 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.412444 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.412560 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.412777 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.412865 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.413098 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.413186 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.413413 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.413513 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.413709 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.413797 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.414018 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.414152 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.414311 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.414408 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.414613 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.414703 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.414909 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.415007 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.415218 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.415306 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.415517 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.415612 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.415815 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.415912 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.416060 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.416150 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.416360 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.416450 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.416700 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.416799 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.417017 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.417106 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.417333 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.417425 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.417582 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.417716 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.417830 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.417919 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.418143 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.418239 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.418463 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.418555 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.418767 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.418862 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.419070 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.419165 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.419366 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.419455 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.419608 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.419696 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.419902 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.420003 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.420195 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.420292 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.420521 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.420612 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.420873 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.420985 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.421116 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.421213 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.421412 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.421500 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.421702 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.421805 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.421999 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.422096 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.422296 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.422391 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.422593 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.422695 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.422889 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.422978 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.423185 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.423317 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.423478 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.423574 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.424107 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.424236 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.424400 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.424489 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.424723 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.424814 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.425030 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.425119 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.425339 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.425426 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.425636 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.425733 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.425931 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.426027 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.426272 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.426412 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.426575 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.426674 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.426880 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.426976 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.427128 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.427231 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.427423 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.427512 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.427722 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.427853 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.428030 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.428122 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.428325 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.428414 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.428647 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.428750 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.428941 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.429042 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.429234 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.429321 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.429532 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.429619 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.429819 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.429915 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.430115 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.430203 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.430412 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.430500 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.430706 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.430874 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.431003 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.431119 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.431293 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.431401 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.431585 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.431694 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.431876 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.431971 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.432171 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.432266 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.432462 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.432602 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.432780 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.432874 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.433067 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.433161 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.433366 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.433464 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.433669 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.433767 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.433964 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.434052 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.434260 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.434358 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.434552 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.434641 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.434857 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.434946 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.435153 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.435242 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.435450 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.435539 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.435762 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.435863 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.436062 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.436158 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.436361 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.436459 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.436736 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.436837 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.437045 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.437135 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.437344 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.437433 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.437646 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.437746 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.437945 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.438033 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.438248 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.438337 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.438544 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.438640 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.438839 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.438934 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.439135 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.439226 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.439434 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.439532 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.439731 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.439819 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.440026 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.440114 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.440318 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.440424 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.440649 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.440738 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.440951 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.441038 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.441252 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.441348 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.441551 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.441640 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.441882 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.442014 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.442191 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:07:25.442323 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.442515 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.442708 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.442803 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.442894 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.443141 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.443301 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.443428 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.443522 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.443767 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.443901 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.444073 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.444217 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.444327 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.444415 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.444652 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.444760 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.444968 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.445062 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.445286 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.445377 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.445586 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.445676 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.445888 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.445977 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.446189 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.446278 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.446498 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.446601 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.446802 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.446895 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.447099 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.447191 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.447400 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.447501 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.447703 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.447793 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.448003 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.448103 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.448309 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.448409 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.448639 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.448729 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.448955 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.449073 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.449264 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.449363 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.449566 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.449655 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.449871 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.449968 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.450172 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.450271 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.450472 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.450562 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.450774 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.450865 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.451068 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.451159 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.451363 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.451454 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.451658 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.451749 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.451950 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.452030 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.452247 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.452340 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.452581 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.452674 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.452901 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.452992 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.453198 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.453298 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.453549 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.453694 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.453803 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.453885 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.454128 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.454263 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.454431 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.454630 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.454743 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.454869 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.454985 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.455077 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.455319 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.455463 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.455592 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.455686 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.455910 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.456042 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.456220 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.456370 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.456495 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.456624 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.456847 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.457037 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.457129 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.457223 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.457437 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.457599 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.457778 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.457909 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.458053 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.458212 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.458382 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.458515 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.458686 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.458816 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.458955 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.459051 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.459279 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.459433 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.459558 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.459651 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.459862 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.459967 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.460163 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.460252 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.460472 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.460594 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.460818 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.460908 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.461112 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.461211 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.461416 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.461514 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.461721 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.461818 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.462029 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.462117 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.462319 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.462421 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.462620 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.462709 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.462916 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.463019 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.463209 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.463306 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.463501 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.463590 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.463799 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.463902 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.464093 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.464191 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.464383 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.464473 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.464697 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.464783 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.464985 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.465075 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.465276 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.465366 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.465587 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.465677 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.465886 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.465976 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.466179 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.466268 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.466479 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.466577 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.466756 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.466850 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.467075 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.467159 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.467370 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.467462 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.467696 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.467781 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.468018 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.468109 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.468322 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.468415 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.468656 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.468757 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.468962 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.469047 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.469266 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.469366 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.469565 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.469650 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.469864 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.469948 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.470162 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.470255 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.470460 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.470544 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.470756 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.470839 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.471054 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.471145 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.471350 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.471433 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.471647 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.471758 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.471947 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.472046 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.472243 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.472327 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.472561 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.472647 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.472857 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.472951 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.473187 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.473272 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.473489 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.473572 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.473791 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.473876 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.474091 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.474175 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.474415 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.474500 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.474714 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.474798 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.475015 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.475098 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.475315 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.475399 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.475615 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.475701 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.475914 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.476002 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.476216 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.476312 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.476546 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.476646 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.476855 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.476947 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.477157 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.477251 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.477455 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.477546 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.477758 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.477841 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.478056 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.478150 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.478364 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.478455 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.478658 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.478750 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.478961 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.479059 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.479286 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.479377 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.479572 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.479657 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.479879 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.479966 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.480174 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.480258 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.480483 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.480618 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.480808 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.480893 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.481108 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.481194 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.481409 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.481494 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.481706 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.481803 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.482000 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.482084 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.482301 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.482393 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.482608 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.482695 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.482908 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.482993 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.483207 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.483300 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.483502 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.483600 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.483806 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.483942 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.484105 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.484200 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.484398 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.484483 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.484716 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.484839 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.485017 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.485115 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.485320 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.485405 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.485620 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.485719 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.485916 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.486014 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.486224 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.486309 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.486517 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.486603 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.486810 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.486904 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.487119 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.487210 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.487418 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.487503 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.487712 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.487799 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.488007 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.488098 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.488300 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.488384 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.488632 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.488754 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.488985 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.489071 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.489283 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.489410 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.489587 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.489682 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.489894 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.489981 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.490194 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.490278 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.490496 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.490589 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.490794 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.490886 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.491093 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.491186 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.491393 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.491477 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.491690 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.491776 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.491986 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.492079 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.492285 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.492397 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.492609 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.492699 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.492913 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.493012 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.493217 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.493302 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.493530 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.493620 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.493828 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.493926 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.494125 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.494217 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.494425 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.494517 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.494720 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.494806 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.495018 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.495104 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.495318 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.495410 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.495617 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.495882 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.495967 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.496206 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.496298 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.496541 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.496648 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.496853 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.496938 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.497164 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.497257 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.497468 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.497561 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.497779 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.497874 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.498085 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.498170 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.498397 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.498481 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.498700 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.498785 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.499004 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.499089 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.499303 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.499388 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.499602 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.499691 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.499906 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.499990 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.500202 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.500295 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.500518 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.500620 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.500822 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.500926 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.501125 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.501232 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.501421 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.501506 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.501720 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.501806 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.502016 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.502110 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.502311 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.502397 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.502615 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.502700 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.502913 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.503181 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.503267 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.503496 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.503581 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.503806 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.503899 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.504106 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.504190 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.504426 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.504557 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.504751 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.504869 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.505033 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.505194 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.505365 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.505517 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.505660 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.505826 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.505988 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.506129 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.506315 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.506434 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.506647 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.506732 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.506945 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.507038 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.507240 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.507325 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.507555 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.507641 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.507850 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.507936 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.508147 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.508232 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.508438 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.508592 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.508767 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.508854 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.509064 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.509157 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.509358 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.509452 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.509655 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.509747 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.509951 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.510037 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.510251 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.510343 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.510549 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.510633 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.510842 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.510927 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.511139 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.511239 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.511433 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.511517 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.511733 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.511817 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.512028 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.512114 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.512323 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.512413 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.512638 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.512739 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.512942 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.513030 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.513236 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.513329 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.513530 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.513615 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.513827 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.513918 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.514121 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.514253 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.514426 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.514511 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.514722 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.514808 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.515020 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.515142 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.515313 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.515408 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.515615 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.515699 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.515913 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.515997 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.516208 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.516306 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.516519 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.516607 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.516834 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.516919 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.517127 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.517224 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.517423 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.517515 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.517721 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.517806 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.518017 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.518110 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.518307 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.518400 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.518605 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.518690 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.518910 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.518996 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.519213 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.519299 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.519504 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.519587 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.519797 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.519882 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.520141 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.520229 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.520442 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.520547 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.520764 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.520851 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.521066 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.521158 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.521362 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.521447 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.521654 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.521739 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.521947 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.522035 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.522243 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.522337 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.522537 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.522622 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.522839 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.522929 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.523139 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.523232 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.523433 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.523518 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.523730 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.523821 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.524024 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.524122 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.524327 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.524412 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.524653 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.524742 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.524957 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.525055 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.525254 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.525339 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.525550 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.525635 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.525854 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.525940 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.526162 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.526254 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.526471 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.526564 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.526769 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.526856 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.527061 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.527146 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.527358 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.527441 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.527657 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.527744 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.527955 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.528040 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.528248 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.528331 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.528565 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.528664 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.528862 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.528989 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.529160 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.529260 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.529456 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.529543 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.529752 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.529836 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.530065 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.530157 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.530367 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.530458 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.530662 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.530747 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.530959 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.531123 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.531258 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.531344 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.531555 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.531639 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.531856 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.531948 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.532157 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.532242 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.532464 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.532606 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.532779 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.532867 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.533080 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.533164 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.533380 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.533465 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.533682 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.533768 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.533977 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.534062 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.534278 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.534362 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.534577 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.534664 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.534872 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.534958 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.535177 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.535260 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.535474 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.535587 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.535795 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.535883 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.536095 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.536189 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.536397 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.536490 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.536724 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.536811 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.537019 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.537114 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.537337 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.537421 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.537655 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.537748 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.537953 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.538048 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.538257 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.538341 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.538566 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.538651 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.538868 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.538960 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.539171 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.539262 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.539472 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.539555 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.539768 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.539861 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.540071 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.540180 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.540374 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.540488 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.540701 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.540820 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.541009 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.541126 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.541309 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.541425 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.541613 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.541722 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.541917 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.542022 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.542215 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.542338 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.542533 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.542627 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.542838 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.542939 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.543133 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.543218 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.543435 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.543529 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.543732 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.543817 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.544034 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.544131 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.544333 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.544471 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.544772 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.544858 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.545079 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.545178 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.545388 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.545473 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.545687 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.545812 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.545995 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.546098 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.546301 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.546386 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.546612 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.546696 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.546919 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.547016 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.547217 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.547304 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.547530 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.547614 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.547834 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.547927 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.548146 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.548243 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.548462 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.548576 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.549126 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.549215 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.549433 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.549517 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.549729 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.549812 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.550042 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.550128 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.550339 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.550445 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.550639 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.550734 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.550937 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.551022 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.551393 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.551482 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.551697 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.551781 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.551999 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.552117 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.552349 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.552442 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.552691 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.552779 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.552989 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.553086 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.553285 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.553452 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.553584 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.553760 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.553881 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.554066 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.554176 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.554386 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.554491 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.554705 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.554790 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.555024 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.555111 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.555340 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.555438 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.555621 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.555723 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.555925 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.556019 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.556219 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.556313 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.556547 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.556651 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.556844 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.556933 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.557154 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.557286 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.557453 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.557549 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.557770 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.557859 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.558078 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.558162 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.558375 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.558475 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.558685 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.558772 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.558985 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.559078 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.559278 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.559377 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.559571 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.559683 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.559863 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.559997 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.560195 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.560317 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.560490 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.560643 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.560821 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.560942 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.561140 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.561248 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.561457 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.561542 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.561757 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.561841 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.562080 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.562169 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.562397 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.562490 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.562709 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.562807 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.563013 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.563098 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.563316 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.563402 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.563613 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.563706 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.563908 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.564000 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.564209 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.564295 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.564548 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.564657 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.564826 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.564920 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.565122 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.565208 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.565422 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.565520 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.565717 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.565802 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.566012 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.566096 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.566312 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.566413 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.566618 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.566703 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.566961 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.567059 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.567261 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.567355 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.567560 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.567653 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.567854 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.567947 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.568151 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.568239 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.568446 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.568553 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.568805 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.568891 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.569102 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.569190 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.569417 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.569502 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.569713 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.569843 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.570024 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.570110 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.570332 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.570431 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.570637 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.570732 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.570945 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.571031 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.571247 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.571333 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.571550 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.571645 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.571853 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.571945 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.572152 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.572235 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.572449 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.572595 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.572772 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.572856 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.573075 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.573159 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.573373 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.573466 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.573675 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.573877 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.573964 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.574196 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.574290 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.574502 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.574587 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.574805 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.574890 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.575107 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.575210 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.575408 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.575494 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.575710 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.575800 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.576014 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.576149 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.576318 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.576404 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.576642 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.576732 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.576948 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.577037 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.577259 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.577352 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.577568 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.577652 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.577878 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.577991 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.578189 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.578301 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.578492 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.578609 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.578799 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.578911 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.579102 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.579213 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.579426 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.579557 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.579709 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.579819 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.580011 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.580125 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.580322 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.580443 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.580653 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.580777 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.580961 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.581072 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.581268 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.581479 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.581592 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.581804 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.581922 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.582116 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.582237 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.582460 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.582629 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.582791 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.582939 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.583090 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.583232 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.583339 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.583443 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.583623 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.583766 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.583938 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.584127 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.584245 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.584351 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.584563 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.584680 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.584871 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.584983 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.585176 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.585288 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.585926 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.586044 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.586044 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.586239 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.586343 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.586454 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.586564 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.586682 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.586787 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.586897 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.587001 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.587193 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.587314 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.587499 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.587617 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.587806 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.587923 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.588124 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.588219 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.588421 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.588522 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.588759 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.588847 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.589099 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.589192 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.589406 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.589512 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.589719 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.589816 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.590023 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.590177 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.590328 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.590483 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.590635 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.590780 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.590952 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.591086 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.591254 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.591377 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.591574 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.591898 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.591993 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.592212 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.592297 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.592557 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.592649 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.592850 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.592950 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.593161 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.593247 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.593467 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.593682 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.593777 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.593993 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.594079 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.594320 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.594405 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.594636 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.594730 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.594943 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.595028 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.595246 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.595331 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.595543 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.595637 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.595841 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.595927 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.596143 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.596231 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.596440 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.596541 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.596767 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.596852 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.597069 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.597154 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.597365 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.597453 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.597738 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.597835 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.597972 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.598127 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.598321 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.598409 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.598616 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.598702 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.598919 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.599004 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.599215 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.599450 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.599544 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.599797 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.599895 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.600088 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.600175 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.600390 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.600477 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.600712 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.600811 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.601025 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.601121 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.601304 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.601390 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.601607 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.601701 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.601903 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.601992 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.602203 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.602288 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.602512 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.602596 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.602822 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.602909 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.603123 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.603208 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.603414 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.603507 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.603719 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.603808 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.604018 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.604102 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.604317 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.604410 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.604654 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.604745 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.604955 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.605040 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.605275 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.605373 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.605576 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.605670 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.605877 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.606092 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.606251 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.606421 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.606733 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.606818 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.607056 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.607252 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.607375 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.607672 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.607818 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.607973 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.608206 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.608310 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.608591 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.608699 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.608894 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.609193 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.609285 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.609494 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.609676 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.609814 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.610095 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.610223 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.610393 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.610627 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.610727 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.610977 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.611063 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.611277 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.611362 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.611576 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.611662 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.611875 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.611975 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.612174 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.612286 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.612472 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.612630 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.612793 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.612935 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.613098 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.613261 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.613430 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.613574 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.613750 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.613924 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.614060 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.614239 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.614364 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.614550 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.614671 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.614969 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.615061 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.615269 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.615472 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.615557 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.615850 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.616141 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.616227 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.616467 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.616618 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.616793 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.616880 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.617090 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.617174 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.617463 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.617549 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.617793 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.617921 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.618103 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.618209 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.618412 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.618497 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.618707 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.618802 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.619020 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.619116 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.619330 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.619415 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.619631 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.619775 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.619941 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.620242 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.620331 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.620579 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.620682 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.620912 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.621016 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.621231 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.621323 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.621544 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.621640 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.621839 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.621933 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.622133 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.622218 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.622427 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.622514 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.622725 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.622823 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.623032 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.623118 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.623331 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.623423 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.623627 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.623722 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.623918 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.624005 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.624215 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.624464 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.624586 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.624811 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.624979 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.625102 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.625394 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.625478 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.625694 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.625781 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.625984 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.626075 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.626275 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.626367 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.626571 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.626658 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.626864 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.626955 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.627156 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.627250 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.627448 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.627535 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.627746 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.627840 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.628040 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.628148 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.628336 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.628524 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.628650 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.628855 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.628941 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.629174 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.629263 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.629545 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.629642 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.629856 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.629961 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.630176 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.630270 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.630487 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.630576 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.630788 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.630882 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.631099 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.631185 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.631401 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.631488 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.631712 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.631811 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.632024 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.632109 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.632329 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.632415 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.632656 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.632757 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.632973 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.633071 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.633269 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.633355 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.633567 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.633654 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.633866 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.633951 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.634164 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.634249 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.634468 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.634562 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.634765 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.634857 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.635061 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.635146 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.635365 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.635452 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.635660 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.635751 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.635957 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.636050 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.636255 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.636340 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.636579 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.636682 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.636887 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.636981 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.637183 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.637269 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.637479 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.637568 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.637778 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.637872 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.638077 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.638168 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.638380 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.638490 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.638679 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.638775 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.638976 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.639061 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.639275 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.639361 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.639574 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.639661 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.639871 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.639956 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.640169 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.640302 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.640465 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.640570 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.640806 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.640891 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.641125 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.641224 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.641427 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.641514 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.641791 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.641893 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.642049 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.642210 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.642366 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.642453 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.642672 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.642759 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.642989 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.643092 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.643305 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.643399 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.643607 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.643693 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.643909 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.644005 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.644204 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.644289 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.644438 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 28 10:07:25.644546 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.644839 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.645170 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.645476 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.645780 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.646085 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.646406 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.646724 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.647023 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.647341 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.647653 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.647967 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.648282 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.648611 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.648932 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.649238 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.649545 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.649851 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.650158 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.650462 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.650774 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.651080 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.651385 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.651697 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.652009 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.652329 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.652673 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.652982 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.653301 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.653622 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.653964 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.654272 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.654611 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.654933 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.655271 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.655546 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.655844 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:07:25.656083 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 28 10:07:25.800392 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO dbcounter [None req-ec75d3eb-a814-4929-84b2-9872d3091252 None None] Registered counter for database nova_api Aug 28 10:07:25.811526 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO dbcounter [None req-f62a7e1d-19b3-4e40-850b-5fbb2ad9d5a4 None None] Registered counter for database nova_api Aug 28 10:07:25.820595 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG oslo_db.sqlalchemy.engines [None req-ec75d3eb-a814-4929-84b2-9872d3091252 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 10:07:25.827785 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG dbcounter [-] [105663] Writer thread running {{(pid=105663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 10:07:25.831518 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_db.sqlalchemy.engines [None req-f62a7e1d-19b3-4e40-850b-5fbb2ad9d5a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105662) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 10:07:25.838330 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG dbcounter [-] [105662] Writer thread running {{(pid=105662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 10:07:25.884150 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.context [None req-ec75d3eb-a814-4929-84b2-9872d3091252 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),72a19395-589c-4f4b-90cf-8b271a69d910(cell1) {{(pid=105663) load_cells /opt/stack/nova/nova/context.py:464}} Aug 28 10:07:25.888055 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG oslo_concurrency.lockutils [None req-ec75d3eb-a814-4929-84b2-9872d3091252 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:07:25.888547 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG oslo_concurrency.lockutils [None req-ec75d3eb-a814-4929-84b2-9872d3091252 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:07:25.891166 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG oslo_concurrency.lockutils [None req-ec75d3eb-a814-4929-84b2-9872d3091252 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=105663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:07:25.891967 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG oslo_concurrency.lockutils [None req-ec75d3eb-a814-4929-84b2-9872d3091252 None None] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:07:25.892343 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG oslo_concurrency.lockutils [None req-ec75d3eb-a814-4929-84b2-9872d3091252 None None] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:07:25.894371 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG oslo_concurrency.lockutils [None req-ec75d3eb-a814-4929-84b2-9872d3091252 None None] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:07:25.896397 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO dbcounter [None req-ec75d3eb-a814-4929-84b2-9872d3091252 None None] Registered counter for database nova_cell0 Aug 28 10:07:25.897837 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.context [None req-f62a7e1d-19b3-4e40-850b-5fbb2ad9d5a4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),72a19395-589c-4f4b-90cf-8b271a69d910(cell1) {{(pid=105662) load_cells /opt/stack/nova/nova/context.py:464}} Aug 28 10:07:25.900537 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO dbcounter [None req-ec75d3eb-a814-4929-84b2-9872d3091252 None None] Registered counter for database nova_cell1 Aug 28 10:07:25.901717 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-f62a7e1d-19b3-4e40-850b-5fbb2ad9d5a4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:07:25.902194 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-f62a7e1d-19b3-4e40-850b-5fbb2ad9d5a4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:07:25.904009 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-f62a7e1d-19b3-4e40-850b-5fbb2ad9d5a4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:07:25.904752 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-f62a7e1d-19b3-4e40-850b-5fbb2ad9d5a4 None None] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:07:25.905189 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-f62a7e1d-19b3-4e40-850b-5fbb2ad9d5a4 None None] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:07:25.907232 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-f62a7e1d-19b3-4e40-850b-5fbb2ad9d5a4 None None] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:07:25.907743 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG oslo_db.sqlalchemy.engines [None req-ec75d3eb-a814-4929-84b2-9872d3091252 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 10:07:25.909303 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO dbcounter [None req-f62a7e1d-19b3-4e40-850b-5fbb2ad9d5a4 None None] Registered counter for database nova_cell0 Aug 28 10:07:25.909993 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG oslo_db.sqlalchemy.engines [None req-ec75d3eb-a814-4929-84b2-9872d3091252 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 10:07:25.913800 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO dbcounter [None req-f62a7e1d-19b3-4e40-850b-5fbb2ad9d5a4 None None] Registered counter for database nova_cell1 Aug 28 10:07:25.916436 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG dbcounter [-] [105663] Writer thread running {{(pid=105663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 10:07:25.919202 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG dbcounter [-] [105663] Writer thread running {{(pid=105663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 10:07:25.921033 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_db.sqlalchemy.engines [None req-f62a7e1d-19b3-4e40-850b-5fbb2ad9d5a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105662) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 10:07:25.925276 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_db.sqlalchemy.engines [None req-f62a7e1d-19b3-4e40-850b-5fbb2ad9d5a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105662) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 10:07:25.926865 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG dbcounter [-] [105662] Writer thread running {{(pid=105662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 10:07:26.062569 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO dbcounter [None req-ec75d3eb-a814-4929-84b2-9872d3091252 None None] Registered counter for database nova_cell0 Aug 28 10:07:26.067309 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG dbcounter [-] [105662] Writer thread running {{(pid=105662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 10:07:26.070076 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG oslo_db.sqlalchemy.engines [None req-ec75d3eb-a814-4929-84b2-9872d3091252 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 10:07:26.075039 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG dbcounter [-] [105663] Writer thread running {{(pid=105663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 10:07:26.076039 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO dbcounter [None req-f62a7e1d-19b3-4e40-850b-5fbb2ad9d5a4 None None] Registered counter for database nova_cell0 Aug 28 10:07:26.084485 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_db.sqlalchemy.engines [None req-f62a7e1d-19b3-4e40-850b-5fbb2ad9d5a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105662) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 10:07:26.089327 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG dbcounter [-] [105662] Writer thread running {{(pid=105662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 10:07:26.412434 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: WARNING keystonemiddleware.auth_token [None req-f62a7e1d-19b3-4e40-850b-5fbb2ad9d5a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 28 10:07:26.414025 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: WARNING keystonemiddleware.auth_token [None req-ec75d3eb-a814-4929-84b2-9872d3091252 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 28 10:07:26.419787 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: WARNING keystonemiddleware.auth_token [None req-f62a7e1d-19b3-4e40-850b-5fbb2ad9d5a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 28 10:07:26.421367 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: WARNING keystonemiddleware.auth_token [None req-ec75d3eb-a814-4929-84b2-9872d3091252 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 28 10:07:26.762654 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: WARNING keystonemiddleware.auth_token [None req-f62a7e1d-19b3-4e40-850b-5fbb2ad9d5a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 28 10:07:26.768078 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: WARNING keystonemiddleware.auth_token [None req-ec75d3eb-a814-4929-84b2-9872d3091252 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 28 10:07:26.768632 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: WARNING keystonemiddleware.auth_token [None req-f62a7e1d-19b3-4e40-850b-5fbb2ad9d5a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 28 10:07:26.773963 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562ae2b589c0 pid: 105662 (default app) Aug 28 10:07:26.774117 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: WARNING keystonemiddleware.auth_token [None req-ec75d3eb-a814-4929-84b2-9872d3091252 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 28 10:07:26.776053 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-f62a7e1d-19b3-4e40-850b-5fbb2ad9d5a4 None None] Calling method '>' {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:07:26.777277 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-f62a7e1d-19b3-4e40-850b-5fbb2ad9d5a4 None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001777 Aug 28 10:07:26.777679 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Sun Aug 28 10:07:26 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:07:26.779406 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562ae2b589c0 pid: 105663 (default app) Aug 28 10:08:44.454601 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-f62a7e1d-19b3-4e40-850b-5fbb2ad9d5a4 None None] Calling method '>' {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:08:44.455653 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-f62a7e1d-19b3-4e40-850b-5fbb2ad9d5a4 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 28 10:08:44.456018 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 931 bytes} [Sun Aug 28 10:08:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:08:44.468303 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG dbcounter [-] [105663] Writing DB stats nova_api:SELECT=3 {{(pid=105663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:44.469238 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG dbcounter [-] [105663] Writing DB stats nova_cell0:SELECT=3 {{(pid=105663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:44.470237 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG dbcounter [-] [105663] Writing DB stats nova_cell1:SELECT=3 {{(pid=105663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:44.471213 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG dbcounter [-] [105663] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:45.361124 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-54e02e86-9c39-4c22-8ca7-a1a200cc5d33 admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:08:45.393998 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-54e02e86-9c39-4c22-8ca7-a1a200cc5d33 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.930892 Aug 28 10:08:45.394962 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1292 bytes} [Sun Aug 28 10:08:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:08:47.810021 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-f62a7e1d-19b3-4e40-850b-5fbb2ad9d5a4 None None] Calling method '>' {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:08:47.811320 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-f62a7e1d-19b3-4e40-850b-5fbb2ad9d5a4 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001723 Aug 28 10:08:47.814518 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 3/4] 10.222.0.40 () {54 vars in 931 bytes} [Sun Aug 28 10:08:47 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:08:48.264189 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-f3d10f3c-b443-4574-8fad-aad954052f9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "ram": 256, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256", "os-flavor-access:is_public": true, "id": "c1"}} {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:08:48.320108 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-f3d10f3c-b443-4574-8fad-aad954052f9a admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.502030 Aug 28 10:08:48.324582 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 2/5] 10.222.0.40 () {64 vars in 1283 bytes} [Sun Aug 28 10:08:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 28 10:08:48.335556 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG dbcounter [-] [105662] Writing DB stats nova_api:SELECT=3 {{(pid=105662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:48.336853 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG dbcounter [-] [105662] Writing DB stats nova_cell0:SELECT=3 {{(pid=105662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:48.337549 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG dbcounter [-] [105662] Writing DB stats nova_cell1:SELECT=3 {{(pid=105662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:48.338611 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG dbcounter [-] [105662] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:48.545166 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-20d765c4-6d08-4d60-9bf1-a8879f1929e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:08:48.610147 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-20d765c4-6d08-4d60-9bf1-a8879f1929e7 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.280339 Aug 28 10:08:48.611065 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 4/6] 10.222.0.40 () {64 vars in 1336 bytes} [Sun Aug 28 10:08:48 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:08:50.938422 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-f3d10f3c-b443-4574-8fad-aad954052f9a admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:08:50.939419 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-f3d10f3c-b443-4574-8fad-aad954052f9a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 28 10:08:50.939998 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 3/7] 10.222.0.40 () {54 vars in 931 bytes} [Sun Aug 28 10:08:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:08:51.581437 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-eb673cbf-91d5-4bee-8f52-daf8da4e7ad8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "name": "ds512M", "id": "d1", "os-flavor-access:is_public": true, "vcpus": 1, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:08:51.620276 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-eb673cbf-91d5-4bee-8f52-daf8da4e7ad8 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.673719 Aug 28 10:08:51.621215 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 5/8] 10.222.0.40 () {64 vars in 1283 bytes} [Sun Aug 28 10:08:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 28 10:08:51.633543 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-743b2b9e-ac2e-4428-81ec-50e3e360da2e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:08:51.671842 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-743b2b9e-ac2e-4428-81ec-50e3e360da2e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042194 Aug 28 10:08:51.672653 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 4/9] 10.222.0.40 () {64 vars in 1336 bytes} [Sun Aug 28 10:08:51 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:08:54.002762 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-eb673cbf-91d5-4bee-8f52-daf8da4e7ad8 admin admin] Calling method '>' {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:08:54.003775 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-eb673cbf-91d5-4bee-8f52-daf8da4e7ad8 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 28 10:08:54.004190 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 931 bytes} [Sun Aug 28 10:08:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:08:54.415649 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-5ea31c77-4fd8-41de-bcb3-2302429ef06c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "disk": 10, "id": "d2", "swap": 0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 1024}} {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:08:54.436237 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-5ea31c77-4fd8-41de-bcb3-2302429ef06c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.425212 Aug 28 10:08:54.436821 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 5/11] 10.222.0.40 () {64 vars in 1283 bytes} [Sun Aug 28 10:08:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 28 10:08:54.449026 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-a6759b3d-5dff-4b73-be4a-3212ba088bb8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:08:54.473428 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-a6759b3d-5dff-4b73-be4a-3212ba088bb8 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028157 Aug 28 10:08:54.474009 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 7/12] 10.222.0.40 () {64 vars in 1336 bytes} [Sun Aug 28 10:08:54 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:08:56.810846 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-5ea31c77-4fd8-41de-bcb3-2302429ef06c admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:08:56.811845 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-5ea31c77-4fd8-41de-bcb3-2302429ef06c admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 28 10:08:56.812227 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 6/13] 10.222.0.40 () {54 vars in 931 bytes} [Sun Aug 28 10:08:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:08:57.250877 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-18039195-c3fe-4eeb-a48a-04b04bb66ce8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "id": "d3", "name": "ds2G", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:08:57.273724 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-18039195-c3fe-4eeb-a48a-04b04bb66ce8 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.455171 Aug 28 10:08:57.275130 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 8/14] 10.222.0.40 () {64 vars in 1283 bytes} [Sun Aug 28 10:08:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 28 10:08:57.287159 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-b838fd8b-131f-450c-a8e0-f50ea2da8594 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:08:57.314834 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-b838fd8b-131f-450c-a8e0-f50ea2da8594 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031551 Aug 28 10:08:57.315405 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 7/15] 10.222.0.40 () {64 vars in 1336 bytes} [Sun Aug 28 10:08:57 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:08:59.656468 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-18039195-c3fe-4eeb-a48a-04b04bb66ce8 admin admin] Calling method '>' {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:08:59.657427 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-18039195-c3fe-4eeb-a48a-04b04bb66ce8 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Aug 28 10:08:59.657819 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 9/16] 10.222.0.40 () {54 vars in 931 bytes} [Sun Aug 28 10:08:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:09:00.087975 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-fc5f209f-521e-42b6-9f37-b270f1c26342 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 4096, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:09:00.108714 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-fc5f209f-521e-42b6-9f37-b270f1c26342 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.443567 Aug 28 10:09:00.109578 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 8/17] 10.222.0.40 () {64 vars in 1283 bytes} [Sun Aug 28 10:08:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 28 10:09:00.121602 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-91c92c70-d2d1-462a-bd0a-7836060bc59b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:09:00.147341 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-91c92c70-d2d1-462a-bd0a-7836060bc59b admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029493 Aug 28 10:09:00.148321 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 10/18] 10.222.0.40 () {64 vars in 1336 bytes} [Sun Aug 28 10:09:00 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:09:02.903501 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-fc5f209f-521e-42b6-9f37-b270f1c26342 admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:02.904846 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-fc5f209f-521e-42b6-9f37-b270f1c26342 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001871 Aug 28 10:09:02.905351 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 9/19] 10.222.0.40 () {54 vars in 931 bytes} [Sun Aug 28 10:09:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:09:03.404300 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-b98caab7-ec28-4c6c-bc9b-62014be996bb admin admin] Calling method '>' {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:03.429672 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-b98caab7-ec28-4c6c-bc9b-62014be996bb admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.516998 Aug 28 10:09:03.430230 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1292 bytes} [Sun Aug 28 10:09:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:09:05.989177 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-fc5f209f-521e-42b6-9f37-b270f1c26342 admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:05.990366 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-fc5f209f-521e-42b6-9f37-b270f1c26342 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001773 Aug 28 10:09:05.990833 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 10/21] 10.222.0.40 () {54 vars in 931 bytes} [Sun Aug 28 10:09:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:09:06.438763 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-bab04bae-9d38-42cf-b8de-fcc1a51c1adb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "id": "1"}} {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:09:06.460495 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-bab04bae-9d38-42cf-b8de-fcc1a51c1adb admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.462937 Aug 28 10:09:06.461317 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 12/22] 10.222.0.40 () {64 vars in 1283 bytes} [Sun Aug 28 10:09:05 2022] POST /compute/v2.1/flavors => generated 402 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 28 10:09:06.473714 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-0e3db432-31fe-45f8-8708-390004359264 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:09:06.499741 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-0e3db432-31fe-45f8-8708-390004359264 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029782 Aug 28 10:09:06.500602 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 11/23] 10.222.0.40 () {64 vars in 1333 bytes} [Sun Aug 28 10:09:06 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:09:08.803019 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-bab04bae-9d38-42cf-b8de-fcc1a51c1adb admin admin] Calling method '>' {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:08.804469 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-bab04bae-9d38-42cf-b8de-fcc1a51c1adb admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001891 Aug 28 10:09:08.805136 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 931 bytes} [Sun Aug 28 10:09:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:09:09.193672 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-1886f41c-0c9f-4c2f-b2ab-c42d607498ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "2", "ram": 2048, "swap": 0, "name": "m1.small", "os-flavor-access:is_public": true}} {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:09:09.213174 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-1886f41c-0c9f-4c2f-b2ab-c42d607498ef admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.401997 Aug 28 10:09:09.213720 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 12/25] 10.222.0.40 () {64 vars in 1283 bytes} [Sun Aug 28 10:09:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 28 10:09:09.225909 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-5228b103-b662-48a7-9480-f6aa4976d1c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:09:09.250233 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-5228b103-b662-48a7-9480-f6aa4976d1c1 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028136 Aug 28 10:09:09.250816 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 14/26] 10.222.0.40 () {64 vars in 1333 bytes} [Sun Aug 28 10:09:09 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:09:11.598284 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-1886f41c-0c9f-4c2f-b2ab-c42d607498ef admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:11.600677 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-1886f41c-0c9f-4c2f-b2ab-c42d607498ef admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001644 Aug 28 10:09:11.601290 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 931 bytes} [Sun Aug 28 10:09:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:09:12.049796 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-9f6358ff-a028-43fd-ba9e-944f858bc5cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "ram": 4096, "name": "m1.medium", "swap": 0, "disk": 40, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:09:12.074317 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-9f6358ff-a028-43fd-ba9e-944f858bc5cd admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.466505 Aug 28 10:09:12.074967 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 15/28] 10.222.0.40 () {64 vars in 1283 bytes} [Sun Aug 28 10:09:11 2022] POST /compute/v2.1/flavors => generated 406 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 28 10:09:12.087294 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-8be44a6b-6277-409c-a2a6-54a2994d7663 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:09:12.117907 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-8be44a6b-6277-409c-a2a6-54a2994d7663 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034357 Aug 28 10:09:12.136531 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 14/29] 10.222.0.40 () {64 vars in 1333 bytes} [Sun Aug 28 10:09:12 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:09:14.479453 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-9f6358ff-a028-43fd-ba9e-944f858bc5cd admin admin] Calling method '>' {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:14.480461 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-9f6358ff-a028-43fd-ba9e-944f858bc5cd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 28 10:09:14.481135 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 931 bytes} [Sun Aug 28 10:09:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:09:14.935265 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-58b7bd26-78c6-4567-8a2a-4c3f62171f69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "disk": 80}} {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:09:14.940825 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG dbcounter [-] [105663] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:09:14.960659 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-58b7bd26-78c6-4567-8a2a-4c3f62171f69 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.473212 Aug 28 10:09:14.961209 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 15/31] 10.222.0.40 () {64 vars in 1283 bytes} [Sun Aug 28 10:09:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 28 10:09:14.973721 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-6b58b39b-aac6-486f-8b86-bfa0571c8f3f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:09:15.000015 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-6b58b39b-aac6-486f-8b86-bfa0571c8f3f admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030106 Aug 28 10:09:15.000751 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 17/32] 10.222.0.40 () {64 vars in 1333 bytes} [Sun Aug 28 10:09:14 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:09:17.312494 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-58b7bd26-78c6-4567-8a2a-4c3f62171f69 admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:17.313906 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-58b7bd26-78c6-4567-8a2a-4c3f62171f69 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002091 Aug 28 10:09:17.314472 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 931 bytes} [Sun Aug 28 10:09:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:09:17.769232 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-125ccfed-cf8c-4228-b082-e89db25506fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "5", "rxtx_factor": 1.0, "ram": 16384, "vcpus": 8, "disk": 160, "swap": 0, "name": "m1.xlarge"}} {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:09:17.790385 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-125ccfed-cf8c-4228-b082-e89db25506fd admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.469859 Aug 28 10:09:17.790939 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 18/34] 10.222.0.40 () {64 vars in 1283 bytes} [Sun Aug 28 10:09:17 2022] POST /compute/v2.1/flavors => generated 408 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 28 10:09:17.803425 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-ffa1c7e8-8163-4359-8b6b-ae479398b771 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:09:17.834271 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-ffa1c7e8-8163-4359-8b6b-ae479398b771 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034862 Aug 28 10:09:17.835203 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 17/35] 10.222.0.40 () {64 vars in 1333 bytes} [Sun Aug 28 10:09:17 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:09:35.940399 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-125ccfed-cf8c-4228-b082-e89db25506fd admin admin] Calling method '>' {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:35.941522 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-125ccfed-cf8c-4228-b082-e89db25506fd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001596 Aug 28 10:09:35.941927 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 931 bytes} [Sun Aug 28 10:09:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:09:35.956065 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG dbcounter [-] [105663] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:09:36.371450 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-09051604-8d84-4c60-9405-e7268030e515 admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:36.390715 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-09051604-8d84-4c60-9405-e7268030e515 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.442083 Aug 28 10:09:36.391233 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1292 bytes} [Sun Aug 28 10:09:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:09:37.472801 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-125ccfed-cf8c-4228-b082-e89db25506fd admin admin] Calling method '>' {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:37.473823 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-125ccfed-cf8c-4228-b082-e89db25506fd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Aug 28 10:09:37.474211 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 20/38] 10.222.0.40 () {56 vars in 1074 bytes} [Sun Aug 28 10:09:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:09:38.041170 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-d1a0c07b-f54d-4689-80d3-95b1f41cd794 admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:38.047125 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.wsgi [None req-d1a0c07b-f54d-4689-80d3-95b1f41cd794 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 28 10:09:38.050496 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-d1a0c07b-f54d-4689-80d3-95b1f41cd794 admin admin] Request method failure captured: Aug 28 10:09:38.050496 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 28 10:09:38.050496 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: Accept: application/json Aug 28 10:09:38.050496 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: Accept-Encoding: gzip, deflate Aug 28 10:09:38.050496 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: Connection: keep-alive Aug 28 10:09:38.050496 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: Content-Length: 0 Aug 28 10:09:38.050496 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: Host: 10.222.0.40 Aug 28 10:09:38.050496 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: Openstack-Api-Version: compute 2.90 Aug 28 10:09:38.050496 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: Openstack-System-Scope: None Aug 28 10:09:38.050496 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: User-Agent: python-novaclient Aug 28 10:09:38.050496 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Auth-Token: gAAAAABjCz7h1skkSGoLFSAM-zKd7t77m20xogVrFSGluAp5iMMFvzH1NkT4HV4mRZuOxnrz9CuCzTMigAuUHx-BLR4IcUXrtW9b2lCa2c7V1O__Qod351-p0FU2S_OGfWKS2Lrdx6pRnetP90T1oUJe9C1HaAUsCLvIDNb7OBuII8yzagthaPk Aug 28 10:09:38.050496 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Domain-Id: None Aug 28 10:09:38.050496 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Domain-Name: None Aug 28 10:09:38.050496 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Identity-Status: Confirmed Aug 28 10:09:38.050496 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Is-Admin-Project: True Aug 28 10:09:38.050496 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Openstack-Nova-Api-Version: 2.90 Aug 28 10:09:38.050496 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Project-Domain-Id: default Aug 28 10:09:38.050496 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Project-Domain-Name: Default Aug 28 10:09:38.050496 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Project-Id: 371955716dbe4a589ec9dad82a9828ca Aug 28 10:09:38.050496 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Project-Name: admin Aug 28 10:09:38.050496 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Role: admin,reader,member Aug 28 10:09:38.050496 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Roles: admin,reader,member Aug 28 10:09:38.052130 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_371955716dbe4a589ec9dad82a9828ca", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/371955716dbe4a589ec9dad82a9828ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/371955716dbe4a589ec9dad82a9828ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/371955716dbe4a589ec9dad82a9828ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:09:38.052130 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Tenant: admin Aug 28 10:09:38.052130 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Tenant-Id: 371955716dbe4a589ec9dad82a9828ca Aug 28 10:09:38.052130 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Tenant-Name: admin Aug 28 10:09:38.052130 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-User: admin Aug 28 10:09:38.052130 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-User-Domain-Id: default Aug 28 10:09:38.052130 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-User-Domain-Name: Default Aug 28 10:09:38.052130 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-User-Id: 9a1bcfcdf46a4813b52d81367ec40dec Aug 28 10:09:38.052130 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-User-Name: admin Aug 28 10:09:38.052130 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: method: > Aug 28 10:09:38.052130 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: exception: Flavor 42 could not be found. Aug 28 10:09:38.052130 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: action_args: {'id': '42'} Aug 28 10:09:38.052130 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:09:38.052130 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:09:38.053375 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 28 10:09:38.053375 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 28 10:09:38.053375 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 28 10:09:38.053375 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 28 10:09:38.053375 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 28 10:09:38.053375 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 28 10:09:38.053375 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 28 10:09:38.053375 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 28 10:09:38.053375 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 28 10:09:38.053375 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:09:38.053375 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 28 10:09:38.053375 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 28 10:09:38.053375 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 28 10:09:38.053375 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi Aug 28 10:09:38.053375 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:09:38.053375 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi Aug 28 10:09:38.053375 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:09:38.053375 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:09:38.053375 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:09:38.054714 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:09:38.054714 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:09:38.054714 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:09:38.054714 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:09:38.054714 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 28 10:09:38.054714 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:09:38.054714 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 28 10:09:38.054714 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi Aug 28 10:09:38.054714 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:09:38.054714 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi Aug 28 10:09:38.054714 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:09:38.054714 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:09:38.054714 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:09:38.054714 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:09:38.054714 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:09:38.054714 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 28 10:09:38.054714 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi Aug 28 10:09:38.054714 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-d1a0c07b-f54d-4689-80d3-95b1f41cd794 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:09:38.056029 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-d1a0c07b-f54d-4689-80d3-95b1f41cd794 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.433772 Aug 28 10:09:38.056029 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1190 bytes} [Sun Aug 28 10:09:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 435 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 28 10:09:38.061786 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-2a141620-2952-4f72-8eb5-5f018ea56c58 admin admin] Calling method '>' {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:38.066147 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG dbcounter [-] [105662] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:09:38.086178 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-2a141620-2952-4f72-8eb5-5f018ea56c58 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028095 Aug 28 10:09:38.086756 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1210 bytes} [Sun Aug 28 10:09:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 28 10:09:38.097021 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-fc54f7d5-4d2a-46f7-82e5-ef8eaf4f5270 admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:38.119374 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-fc54f7d5-4d2a-46f7-82e5-ef8eaf4f5270 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026123 Aug 28 10:09:38.119893 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1210 bytes} [Sun Aug 28 10:09:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:09:38.129833 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-22f69a65-2ded-4148-92f3-37906ee7e105 admin admin] Calling method '>' {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:38.135723 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.wsgi [None req-22f69a65-2ded-4148-92f3-37906ee7e105 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 28 10:09:38.139020 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-22f69a65-2ded-4148-92f3-37906ee7e105 admin admin] Request method failure captured: Aug 28 10:09:38.139020 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 28 10:09:38.139020 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: Accept: application/json Aug 28 10:09:38.139020 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: Accept-Encoding: gzip, deflate Aug 28 10:09:38.139020 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: Connection: keep-alive Aug 28 10:09:38.139020 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: Content-Length: 0 Aug 28 10:09:38.139020 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: Host: 10.222.0.40 Aug 28 10:09:38.139020 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: Openstack-Api-Version: compute 2.90 Aug 28 10:09:38.139020 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: Openstack-System-Scope: None Aug 28 10:09:38.139020 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: User-Agent: python-novaclient Aug 28 10:09:38.139020 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Auth-Token: gAAAAABjCz7h1skkSGoLFSAM-zKd7t77m20xogVrFSGluAp5iMMFvzH1NkT4HV4mRZuOxnrz9CuCzTMigAuUHx-BLR4IcUXrtW9b2lCa2c7V1O__Qod351-p0FU2S_OGfWKS2Lrdx6pRnetP90T1oUJe9C1HaAUsCLvIDNb7OBuII8yzagthaPk Aug 28 10:09:38.139020 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Domain-Id: None Aug 28 10:09:38.139020 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Domain-Name: None Aug 28 10:09:38.139020 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Identity-Status: Confirmed Aug 28 10:09:38.139020 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Is-Admin-Project: True Aug 28 10:09:38.139020 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Openstack-Nova-Api-Version: 2.90 Aug 28 10:09:38.139020 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Project-Domain-Id: default Aug 28 10:09:38.139020 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Project-Domain-Name: Default Aug 28 10:09:38.139020 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Project-Id: 371955716dbe4a589ec9dad82a9828ca Aug 28 10:09:38.139020 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Project-Name: admin Aug 28 10:09:38.139020 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Role: admin,reader,member Aug 28 10:09:38.139020 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Roles: admin,reader,member Aug 28 10:09:38.140426 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_371955716dbe4a589ec9dad82a9828ca", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/371955716dbe4a589ec9dad82a9828ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/371955716dbe4a589ec9dad82a9828ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/371955716dbe4a589ec9dad82a9828ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:09:38.140426 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Tenant: admin Aug 28 10:09:38.140426 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Tenant-Id: 371955716dbe4a589ec9dad82a9828ca Aug 28 10:09:38.140426 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Tenant-Name: admin Aug 28 10:09:38.140426 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-User: admin Aug 28 10:09:38.140426 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-User-Domain-Id: default Aug 28 10:09:38.140426 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-User-Domain-Name: Default Aug 28 10:09:38.140426 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-User-Id: 9a1bcfcdf46a4813b52d81367ec40dec Aug 28 10:09:38.140426 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-User-Name: admin Aug 28 10:09:38.140426 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: method: > Aug 28 10:09:38.140426 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: exception: Flavor 42 could not be found. Aug 28 10:09:38.140426 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: action_args: {'id': '42'} Aug 28 10:09:38.140426 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:09:38.140426 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:09:38.142363 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 28 10:09:38.142363 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 28 10:09:38.142363 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 28 10:09:38.142363 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 28 10:09:38.142363 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 28 10:09:38.142363 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 28 10:09:38.142363 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 28 10:09:38.142363 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 28 10:09:38.142363 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 28 10:09:38.142363 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:09:38.142363 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 28 10:09:38.142363 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 28 10:09:38.142363 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 28 10:09:38.142363 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi Aug 28 10:09:38.142363 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:09:38.142363 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi Aug 28 10:09:38.142363 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:09:38.142363 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:09:38.142363 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:09:38.143640 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:09:38.143640 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:09:38.143640 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:09:38.143640 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:09:38.143640 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 28 10:09:38.143640 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:09:38.143640 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 28 10:09:38.143640 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi Aug 28 10:09:38.143640 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:09:38.143640 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi Aug 28 10:09:38.143640 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:09:38.143640 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:09:38.143640 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:09:38.143640 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:09:38.143640 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:09:38.143640 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 28 10:09:38.143640 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi Aug 28 10:09:38.143640 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-22f69a65-2ded-4148-92f3-37906ee7e105 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:09:38.144715 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-22f69a65-2ded-4148-92f3-37906ee7e105 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014602 Aug 28 10:09:38.144715 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1190 bytes} [Sun Aug 28 10:09:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 28 10:09:39.117669 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-fc54f7d5-4d2a-46f7-82e5-ef8eaf4f5270 admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:39.118680 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-fc54f7d5-4d2a-46f7-82e5-ef8eaf4f5270 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 28 10:09:39.119073 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 21/43] 10.222.0.40 () {56 vars in 1074 bytes} [Sun Aug 28 10:09:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:09:39.704138 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-c49786cb-9f90-411e-84fc-376a3e39edff admin admin] Calling method '>' {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:39.710099 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.wsgi [None req-c49786cb-9f90-411e-84fc-376a3e39edff admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 28 10:09:39.711606 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-c49786cb-9f90-411e-84fc-376a3e39edff admin admin] Request method failure captured: Aug 28 10:09:39.711606 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 28 10:09:39.711606 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: Accept: application/json Aug 28 10:09:39.711606 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: Accept-Encoding: gzip, deflate Aug 28 10:09:39.711606 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: Connection: keep-alive Aug 28 10:09:39.711606 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: Content-Length: 0 Aug 28 10:09:39.711606 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: Host: 10.222.0.40 Aug 28 10:09:39.711606 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: Openstack-Api-Version: compute 2.90 Aug 28 10:09:39.711606 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: Openstack-System-Scope: None Aug 28 10:09:39.711606 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: User-Agent: python-novaclient Aug 28 10:09:39.711606 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Auth-Token: gAAAAABjCz7jd73RfvlaKV_4HDWIY-e6Kyywf8YLWG21cTzz8GIniEFChO-IicPeTRBIkntLZgQ80QTYgPA5TYAW2ZJX6yxy5u9q16g8MEJDWD1BkWsI8OAwOZ9PqW2IEmN6GOkZC2Xb3_jfHgsKHt9xIwyb6Rfvwoyjsne3zFoaQWJxQLNdFrQ Aug 28 10:09:39.711606 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Domain-Id: None Aug 28 10:09:39.711606 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Domain-Name: None Aug 28 10:09:39.711606 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Identity-Status: Confirmed Aug 28 10:09:39.711606 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Is-Admin-Project: True Aug 28 10:09:39.711606 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Openstack-Nova-Api-Version: 2.90 Aug 28 10:09:39.711606 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Project-Domain-Id: default Aug 28 10:09:39.711606 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Project-Domain-Name: Default Aug 28 10:09:39.711606 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Project-Id: 371955716dbe4a589ec9dad82a9828ca Aug 28 10:09:39.711606 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Project-Name: admin Aug 28 10:09:39.711606 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Role: admin,reader,member Aug 28 10:09:39.711606 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Roles: admin,reader,member Aug 28 10:09:39.713146 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_371955716dbe4a589ec9dad82a9828ca", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/371955716dbe4a589ec9dad82a9828ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/371955716dbe4a589ec9dad82a9828ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/371955716dbe4a589ec9dad82a9828ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:09:39.713146 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Tenant: admin Aug 28 10:09:39.713146 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Tenant-Id: 371955716dbe4a589ec9dad82a9828ca Aug 28 10:09:39.713146 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Tenant-Name: admin Aug 28 10:09:39.713146 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-User: admin Aug 28 10:09:39.713146 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-User-Domain-Id: default Aug 28 10:09:39.713146 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-User-Domain-Name: Default Aug 28 10:09:39.713146 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-User-Id: 9a1bcfcdf46a4813b52d81367ec40dec Aug 28 10:09:39.713146 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-User-Name: admin Aug 28 10:09:39.713146 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: method: > Aug 28 10:09:39.713146 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: exception: Flavor 84 could not be found. Aug 28 10:09:39.713146 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: action_args: {'id': '84'} Aug 28 10:09:39.713146 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:09:39.713146 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:09:39.714001 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 28 10:09:39.714001 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 28 10:09:39.714001 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 28 10:09:39.714001 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 28 10:09:39.714001 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 28 10:09:39.714001 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 28 10:09:39.714001 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 28 10:09:39.714001 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 28 10:09:39.714001 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 28 10:09:39.714001 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:09:39.714001 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 28 10:09:39.714001 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 28 10:09:39.714001 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 28 10:09:39.714001 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi Aug 28 10:09:39.714001 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:09:39.714001 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi Aug 28 10:09:39.714001 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:09:39.714001 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:09:39.714001 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:09:39.715276 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:09:39.715276 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:09:39.715276 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:09:39.715276 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:09:39.715276 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 28 10:09:39.715276 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:09:39.715276 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 28 10:09:39.715276 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi Aug 28 10:09:39.715276 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:09:39.715276 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi Aug 28 10:09:39.715276 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:09:39.715276 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:09:39.715276 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:09:39.715276 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:09:39.715276 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:09:39.715276 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 28 10:09:39.715276 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi Aug 28 10:09:39.715276 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-c49786cb-9f90-411e-84fc-376a3e39edff admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:09:39.716478 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-c49786cb-9f90-411e-84fc-376a3e39edff admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.441947 Aug 28 10:09:39.716478 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1190 bytes} [Sun Aug 28 10:09:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 443 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 28 10:09:39.722917 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-9fdbca9d-0f55-48eb-8320-bb72360b1ae4 admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:39.738067 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-9fdbca9d-0f55-48eb-8320-bb72360b1ae4 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018854 Aug 28 10:09:39.738582 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1210 bytes} [Sun Aug 28 10:09:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 28 10:09:39.750103 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-b1239ad4-15dd-4db7-8ee1-1df53d5e63d7 admin admin] Calling method '>' {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:39.765116 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-b1239ad4-15dd-4db7-8ee1-1df53d5e63d7 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018616 Aug 28 10:09:39.765632 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1210 bytes} [Sun Aug 28 10:09:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:09:39.785541 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-c94837d6-72ef-4c6d-8d79-7f52eb01ff9b admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:39.791613 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.wsgi [None req-c94837d6-72ef-4c6d-8d79-7f52eb01ff9b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 28 10:09:39.793186 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-c94837d6-72ef-4c6d-8d79-7f52eb01ff9b admin admin] Request method failure captured: Aug 28 10:09:39.793186 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 28 10:09:39.793186 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: Accept: application/json Aug 28 10:09:39.793186 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: Accept-Encoding: gzip, deflate Aug 28 10:09:39.793186 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: Connection: keep-alive Aug 28 10:09:39.793186 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: Content-Length: 0 Aug 28 10:09:39.793186 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: Host: 10.222.0.40 Aug 28 10:09:39.793186 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: Openstack-Api-Version: compute 2.90 Aug 28 10:09:39.793186 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: Openstack-System-Scope: None Aug 28 10:09:39.793186 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: User-Agent: python-novaclient Aug 28 10:09:39.793186 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Auth-Token: gAAAAABjCz7jd73RfvlaKV_4HDWIY-e6Kyywf8YLWG21cTzz8GIniEFChO-IicPeTRBIkntLZgQ80QTYgPA5TYAW2ZJX6yxy5u9q16g8MEJDWD1BkWsI8OAwOZ9PqW2IEmN6GOkZC2Xb3_jfHgsKHt9xIwyb6Rfvwoyjsne3zFoaQWJxQLNdFrQ Aug 28 10:09:39.793186 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Domain-Id: None Aug 28 10:09:39.793186 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Domain-Name: None Aug 28 10:09:39.793186 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Identity-Status: Confirmed Aug 28 10:09:39.793186 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Is-Admin-Project: True Aug 28 10:09:39.793186 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Openstack-Nova-Api-Version: 2.90 Aug 28 10:09:39.793186 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Project-Domain-Id: default Aug 28 10:09:39.793186 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Project-Domain-Name: Default Aug 28 10:09:39.793186 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Project-Id: 371955716dbe4a589ec9dad82a9828ca Aug 28 10:09:39.793186 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Project-Name: admin Aug 28 10:09:39.793186 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Role: admin,reader,member Aug 28 10:09:39.793186 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Roles: admin,reader,member Aug 28 10:09:39.794606 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_371955716dbe4a589ec9dad82a9828ca", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/371955716dbe4a589ec9dad82a9828ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/371955716dbe4a589ec9dad82a9828ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/371955716dbe4a589ec9dad82a9828ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:09:39.794606 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Tenant: admin Aug 28 10:09:39.794606 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Tenant-Id: 371955716dbe4a589ec9dad82a9828ca Aug 28 10:09:39.794606 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Tenant-Name: admin Aug 28 10:09:39.794606 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-User: admin Aug 28 10:09:39.794606 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-User-Domain-Id: default Aug 28 10:09:39.794606 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-User-Domain-Name: Default Aug 28 10:09:39.794606 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-User-Id: 9a1bcfcdf46a4813b52d81367ec40dec Aug 28 10:09:39.794606 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-User-Name: admin Aug 28 10:09:39.794606 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: method: > Aug 28 10:09:39.794606 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: exception: Flavor 84 could not be found. Aug 28 10:09:39.794606 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: action_args: {'id': '84'} Aug 28 10:09:39.794606 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:09:39.794606 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:09:39.795608 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 28 10:09:39.795608 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 28 10:09:39.795608 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 28 10:09:39.795608 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 28 10:09:39.795608 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 28 10:09:39.795608 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 28 10:09:39.795608 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 28 10:09:39.795608 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 28 10:09:39.795608 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 28 10:09:39.795608 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:09:39.795608 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 28 10:09:39.795608 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 28 10:09:39.795608 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 28 10:09:39.795608 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi Aug 28 10:09:39.795608 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:09:39.795608 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi Aug 28 10:09:39.795608 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:09:39.795608 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:09:39.795608 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:09:39.797040 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:09:39.797040 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:09:39.797040 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:09:39.797040 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:09:39.797040 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 28 10:09:39.797040 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:09:39.797040 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 28 10:09:39.797040 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi Aug 28 10:09:39.797040 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:09:39.797040 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi Aug 28 10:09:39.797040 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:09:39.797040 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:09:39.797040 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:09:39.797040 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:09:39.797040 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:09:39.797040 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 28 10:09:39.797040 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi Aug 28 10:09:39.797040 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-c94837d6-72ef-4c6d-8d79-7f52eb01ff9b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:09:39.798308 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-c94837d6-72ef-4c6d-8d79-7f52eb01ff9b admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012719 Aug 28 10:09:39.798308 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 23/47] 10.222.0.40 () {60 vars in 1190 bytes} [Sun Aug 28 10:09:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 28 10:09:40.765169 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-b1239ad4-15dd-4db7-8ee1-1df53d5e63d7 admin admin] Calling method '>' {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:40.766180 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-b1239ad4-15dd-4db7-8ee1-1df53d5e63d7 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 28 10:09:40.766581 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 25/48] 10.222.0.40 () {56 vars in 1074 bytes} [Sun Aug 28 10:09:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:09:41.356671 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-4d6dcad6-6c63-4a99-a8a4-bcf7ca3f3dbf admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:41.362605 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.wsgi [None req-4d6dcad6-6c63-4a99-a8a4-bcf7ca3f3dbf admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 28 10:09:41.364151 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-4d6dcad6-6c63-4a99-a8a4-bcf7ca3f3dbf admin admin] Request method failure captured: Aug 28 10:09:41.364151 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 28 10:09:41.364151 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: Accept: application/json Aug 28 10:09:41.364151 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: Accept-Encoding: gzip, deflate Aug 28 10:09:41.364151 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: Connection: keep-alive Aug 28 10:09:41.364151 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: Content-Length: 0 Aug 28 10:09:41.364151 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: Host: 10.222.0.40 Aug 28 10:09:41.364151 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: Openstack-Api-Version: compute 2.90 Aug 28 10:09:41.364151 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: Openstack-System-Scope: None Aug 28 10:09:41.364151 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: User-Agent: python-novaclient Aug 28 10:09:41.364151 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Auth-Token: gAAAAABjCz7ksvrrUyv9votRTaDR2ub6fEdFZehIVfdlrvjNWFNRgxPSozTeIoxnpvh0HS_tfjiKqO6BHdg3-v5zfXg6wvjOpnbcRHPzoan41mK5Vg_Dg7ceUxFxBsUOIZZETwQ2mXw8Ro5pEqcn-kb7NOIheUBsgOLoRwzzU0fzhtxrtXx96D0 Aug 28 10:09:41.364151 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Domain-Id: None Aug 28 10:09:41.364151 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Domain-Name: None Aug 28 10:09:41.364151 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Identity-Status: Confirmed Aug 28 10:09:41.364151 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Is-Admin-Project: True Aug 28 10:09:41.364151 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Openstack-Nova-Api-Version: 2.90 Aug 28 10:09:41.364151 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Project-Domain-Id: default Aug 28 10:09:41.364151 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Project-Domain-Name: Default Aug 28 10:09:41.364151 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Project-Id: 371955716dbe4a589ec9dad82a9828ca Aug 28 10:09:41.364151 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Project-Name: admin Aug 28 10:09:41.364151 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Role: admin,reader,member Aug 28 10:09:41.364151 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Roles: admin,reader,member Aug 28 10:09:41.365667 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_371955716dbe4a589ec9dad82a9828ca", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/371955716dbe4a589ec9dad82a9828ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/371955716dbe4a589ec9dad82a9828ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/371955716dbe4a589ec9dad82a9828ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:09:41.365667 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Tenant: admin Aug 28 10:09:41.365667 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Tenant-Id: 371955716dbe4a589ec9dad82a9828ca Aug 28 10:09:41.365667 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-Tenant-Name: admin Aug 28 10:09:41.365667 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-User: admin Aug 28 10:09:41.365667 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-User-Domain-Id: default Aug 28 10:09:41.365667 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-User-Domain-Name: Default Aug 28 10:09:41.365667 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-User-Id: 9a1bcfcdf46a4813b52d81367ec40dec Aug 28 10:09:41.365667 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: X-User-Name: admin Aug 28 10:09:41.365667 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: method: > Aug 28 10:09:41.365667 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: exception: Flavor 451 could not be found. Aug 28 10:09:41.365667 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: action_args: {'id': '451'} Aug 28 10:09:41.365667 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:09:41.365667 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:09:41.366610 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 28 10:09:41.366610 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 28 10:09:41.366610 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 28 10:09:41.366610 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 28 10:09:41.366610 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 28 10:09:41.366610 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 28 10:09:41.366610 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 28 10:09:41.366610 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 28 10:09:41.366610 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 28 10:09:41.366610 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:09:41.366610 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 28 10:09:41.366610 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 28 10:09:41.366610 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 28 10:09:41.366610 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi Aug 28 10:09:41.366610 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:09:41.366610 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi Aug 28 10:09:41.366610 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:09:41.366610 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:09:41.366610 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:09:41.367957 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:09:41.367957 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:09:41.367957 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:09:41.367957 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:09:41.367957 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 28 10:09:41.367957 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:09:41.367957 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 28 10:09:41.367957 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi Aug 28 10:09:41.367957 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:09:41.367957 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi Aug 28 10:09:41.367957 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:09:41.367957 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:09:41.367957 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:09:41.367957 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:09:41.367957 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:09:41.367957 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 28 10:09:41.367957 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: ERROR nova.api.openstack.wsgi Aug 28 10:09:41.367957 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-4d6dcad6-6c63-4a99-a8a4-bcf7ca3f3dbf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:09:41.369193 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-4d6dcad6-6c63-4a99-a8a4-bcf7ca3f3dbf admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.462847 Aug 28 10:09:41.369193 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1193 bytes} [Sun Aug 28 10:09:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 464 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 28 10:09:41.377841 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-c7254747-c63d-425c-af91-869aad09b38b admin admin] Calling method '>' {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:41.398160 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-c7254747-c63d-425c-af91-869aad09b38b admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026065 Aug 28 10:09:41.398680 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1210 bytes} [Sun Aug 28 10:09:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:09:41.408161 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-3b40679f-9f71-464c-9193-065e1dd00cfb admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:41.423161 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-3b40679f-9f71-464c-9193-065e1dd00cfb admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018540 Aug 28 10:09:41.423684 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1210 bytes} [Sun Aug 28 10:09:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:09:41.433412 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-35d24eac-9220-4633-b9cb-41306f34b832 admin admin] Calling method '>' {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:41.438954 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.wsgi [None req-35d24eac-9220-4633-b9cb-41306f34b832 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 28 10:09:41.440455 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-35d24eac-9220-4633-b9cb-41306f34b832 admin admin] Request method failure captured: Aug 28 10:09:41.440455 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 28 10:09:41.440455 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: Accept: application/json Aug 28 10:09:41.440455 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: Accept-Encoding: gzip, deflate Aug 28 10:09:41.440455 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: Connection: keep-alive Aug 28 10:09:41.440455 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: Content-Length: 0 Aug 28 10:09:41.440455 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: Host: 10.222.0.40 Aug 28 10:09:41.440455 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: Openstack-Api-Version: compute 2.90 Aug 28 10:09:41.440455 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: Openstack-System-Scope: None Aug 28 10:09:41.440455 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: User-Agent: python-novaclient Aug 28 10:09:41.440455 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Auth-Token: gAAAAABjCz7ksvrrUyv9votRTaDR2ub6fEdFZehIVfdlrvjNWFNRgxPSozTeIoxnpvh0HS_tfjiKqO6BHdg3-v5zfXg6wvjOpnbcRHPzoan41mK5Vg_Dg7ceUxFxBsUOIZZETwQ2mXw8Ro5pEqcn-kb7NOIheUBsgOLoRwzzU0fzhtxrtXx96D0 Aug 28 10:09:41.440455 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Domain-Id: None Aug 28 10:09:41.440455 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Domain-Name: None Aug 28 10:09:41.440455 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Identity-Status: Confirmed Aug 28 10:09:41.440455 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Is-Admin-Project: True Aug 28 10:09:41.440455 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Openstack-Nova-Api-Version: 2.90 Aug 28 10:09:41.440455 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Project-Domain-Id: default Aug 28 10:09:41.440455 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Project-Domain-Name: Default Aug 28 10:09:41.440455 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Project-Id: 371955716dbe4a589ec9dad82a9828ca Aug 28 10:09:41.440455 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Project-Name: admin Aug 28 10:09:41.440455 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Role: admin,reader,member Aug 28 10:09:41.440455 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Roles: admin,reader,member Aug 28 10:09:41.441779 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_371955716dbe4a589ec9dad82a9828ca", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/371955716dbe4a589ec9dad82a9828ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/371955716dbe4a589ec9dad82a9828ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/371955716dbe4a589ec9dad82a9828ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:09:41.441779 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Tenant: admin Aug 28 10:09:41.441779 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Tenant-Id: 371955716dbe4a589ec9dad82a9828ca Aug 28 10:09:41.441779 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-Tenant-Name: admin Aug 28 10:09:41.441779 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-User: admin Aug 28 10:09:41.441779 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-User-Domain-Id: default Aug 28 10:09:41.441779 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-User-Domain-Name: Default Aug 28 10:09:41.441779 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-User-Id: 9a1bcfcdf46a4813b52d81367ec40dec Aug 28 10:09:41.441779 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: X-User-Name: admin Aug 28 10:09:41.441779 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: method: > Aug 28 10:09:41.441779 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: exception: Flavor 451 could not be found. Aug 28 10:09:41.441779 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: action_args: {'id': '451'} Aug 28 10:09:41.441779 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:09:41.441779 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:09:41.442701 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 28 10:09:41.442701 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 28 10:09:41.442701 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 28 10:09:41.442701 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 28 10:09:41.442701 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 28 10:09:41.442701 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 28 10:09:41.442701 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 28 10:09:41.442701 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 28 10:09:41.442701 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 28 10:09:41.442701 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:09:41.442701 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 28 10:09:41.442701 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 28 10:09:41.442701 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 28 10:09:41.442701 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi Aug 28 10:09:41.442701 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:09:41.442701 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi Aug 28 10:09:41.442701 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:09:41.442701 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:09:41.442701 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:09:41.443762 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:09:41.443762 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:09:41.443762 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:09:41.443762 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:09:41.443762 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 28 10:09:41.443762 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:09:41.443762 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 28 10:09:41.443762 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi Aug 28 10:09:41.443762 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:09:41.443762 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi Aug 28 10:09:41.443762 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:09:41.443762 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:09:41.443762 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:09:41.443762 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:09:41.443762 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:09:41.443762 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 28 10:09:41.443762 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: ERROR nova.api.openstack.wsgi Aug 28 10:09:41.443762 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-35d24eac-9220-4633-b9cb-41306f34b832 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:09:41.445061 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-35d24eac-9220-4633-b9cb-41306f34b832 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011986 Aug 28 10:09:41.445061 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 27/52] 10.222.0.40 () {60 vars in 1193 bytes} [Sun Aug 28 10:09:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 28 10:09:42.432834 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-3b40679f-9f71-464c-9193-065e1dd00cfb admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:42.433854 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-3b40679f-9f71-464c-9193-065e1dd00cfb admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Aug 28 10:09:42.434256 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1074 bytes} [Sun Aug 28 10:09:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:09:42.992628 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-95d1740e-eef5-410c-b7c4-268106e480c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:09:43.014176 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-95d1740e-eef5-410c-b7c4-268106e480c5 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.443091 Aug 28 10:09:43.014720 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 28/54] 10.222.0.40 () {64 vars in 1235 bytes} [Sun Aug 28 10:09:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 28 10:09:43.986958 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-3b40679f-9f71-464c-9193-065e1dd00cfb admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:43.987970 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-3b40679f-9f71-464c-9193-065e1dd00cfb admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 28 10:09:43.988396 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1074 bytes} [Sun Aug 28 10:09:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:09:44.532811 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-4ef3533d-9cc7-416b-9492-c1e04f1425e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:09:44.559434 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-4ef3533d-9cc7-416b-9492-c1e04f1425e8 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.433696 Aug 28 10:09:44.559983 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 29/56] 10.222.0.40 () {64 vars in 1235 bytes} [Sun Aug 28 10:09:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 28 10:09:45.533862 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-3b40679f-9f71-464c-9193-065e1dd00cfb admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:45.534916 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-3b40679f-9f71-464c-9193-065e1dd00cfb admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 28 10:09:45.535313 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1074 bytes} [Sun Aug 28 10:09:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:09:46.103370 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-a7fa3828-a24f-4626-95d1-d3fb84103672 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:09:46.125161 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-a7fa3828-a24f-4626-95d1-d3fb84103672 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.452908 Aug 28 10:09:46.125713 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 30/58] 10.222.0.40 () {64 vars in 1235 bytes} [Sun Aug 28 10:09:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 28 10:09:47.105387 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-3b40679f-9f71-464c-9193-065e1dd00cfb admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:47.106391 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-3b40679f-9f71-464c-9193-065e1dd00cfb admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 28 10:09:47.106779 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 29/59] 10.222.0.40 () {56 vars in 1074 bytes} [Sun Aug 28 10:09:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:09:47.648552 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-6934c65f-616b-4290-bd18-3c38f66aa7b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:09:47.669532 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-6934c65f-616b-4290-bd18-3c38f66aa7b7 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.426253 Aug 28 10:09:47.670069 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 31/60] 10.222.0.40 () {64 vars in 1235 bytes} [Sun Aug 28 10:09:47 2022] POST /compute/v2.1/flavors => generated 409 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 28 10:09:48.635465 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-3b40679f-9f71-464c-9193-065e1dd00cfb admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:48.636475 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-3b40679f-9f71-464c-9193-065e1dd00cfb admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 28 10:09:48.636917 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 30/61] 10.222.0.40 () {56 vars in 1074 bytes} [Sun Aug 28 10:09:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:09:49.198969 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-499af6b3-38e0-47b1-98dd-252a5c6dfe8e admin admin] Calling method '>' {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:09:49.228343 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-499af6b3-38e0-47b1-98dd-252a5c6dfe8e admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.455587 Aug 28 10:09:49.228901 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Sun Aug 28 10:09:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:10:42.750951 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-3b40679f-9f71-464c-9193-065e1dd00cfb admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:10:42.752410 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-3b40679f-9f71-464c-9193-065e1dd00cfb admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002316 Aug 28 10:10:42.753070 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 931 bytes} [Sun Aug 28 10:10:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:10:42.766873 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG dbcounter [-] [105662] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:43.179817 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-db987b59-b9fb-48a6-8d3e-1873cbf782e0 admin admin] Calling method '>' {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:10:43.200905 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-db987b59-b9fb-48a6-8d3e-1873cbf782e0 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.441270 Aug 28 10:10:43.201440 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1292 bytes} [Sun Aug 28 10:10:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:10:43.228985 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG dbcounter [-] [105663] Writing DB stats nova_api:SELECT=14 {{(pid=105663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:43.233497 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-d34b5388-d8ee-4cd3-86a6-3f99ce6118c0 admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:10:43.241687 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-d34b5388-d8ee-4cd3-86a6-3f99ce6118c0 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014183 Aug 28 10:10:43.242203 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1283 bytes} [Sun Aug 28 10:10:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:10:43.256113 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-f027e5a5-a498-4593-a5a7-38c9a9abd3eb admin admin] Calling method '>' {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:10:43.267588 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-f027e5a5-a498-4593-a5a7-38c9a9abd3eb admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017023 Aug 28 10:10:43.268297 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1286 bytes} [Sun Aug 28 10:10:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:10:43.283308 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-b0fffffa-e613-4b4c-bc29-f3769e010aa6 admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:10:43.291143 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-b0fffffa-e613-4b4c-bc29-f3769e010aa6 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011636 Aug 28 10:10:43.291658 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1286 bytes} [Sun Aug 28 10:10:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:10:43.303531 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-a22312a4-3cc5-4e30-bdbf-95cb62525635 admin admin] Calling method '>' {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:10:43.311351 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-a22312a4-3cc5-4e30-bdbf-95cb62525635 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011386 Aug 28 10:10:43.311901 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1283 bytes} [Sun Aug 28 10:10:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:13:47.680653 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-b0fffffa-e613-4b4c-bc29-f3769e010aa6 admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:13:47.681659 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-b0fffffa-e613-4b4c-bc29-f3769e010aa6 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 28 10:13:47.682055 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 34/69] 10.222.0.40 () {56 vars in 1074 bytes} [Sun Aug 28 10:13:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:13:47.822755 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG dbcounter [-] [105662] Writing DB stats nova_api:SELECT=6 {{(pid=105662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:13:47.992621 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-13df405d-e0c5-4282-b3af-a7a8eb6fdf78 admin admin] Calling method '>' {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:13:47.996107 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-13df405d-e0c5-4282-b3af-a7a8eb6fdf78 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:13:47.996679 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-13df405d-e0c5-4282-b3af-a7a8eb6fdf78 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:13:47.997103 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-13df405d-e0c5-4282-b3af-a7a8eb6fdf78 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:13:47.997842 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-13df405d-e0c5-4282-b3af-a7a8eb6fdf78 admin admin] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:13:47.998288 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-13df405d-e0c5-4282-b3af-a7a8eb6fdf78 admin admin] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:13:47.998698 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-13df405d-e0c5-4282-b3af-a7a8eb6fdf78 admin admin] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:13:48.032785 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-13df405d-e0c5-4282-b3af-a7a8eb6fdf78 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.212582 Aug 28 10:13:48.033339 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1193 bytes} [Sun Aug 28 10:13:47 2022] GET /compute/v2.1/os-services => generated 791 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 28 10:13:48.872812 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-b0fffffa-e613-4b4c-bc29-f3769e010aa6 admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:13:48.873859 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-b0fffffa-e613-4b4c-bc29-f3769e010aa6 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 28 10:13:48.874232 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1074 bytes} [Sun Aug 28 10:13:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:13:49.070156 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-1388b6b5-087e-4076-9527-9337d278fc94 admin admin] Calling method '>' {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:13:49.073662 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-1388b6b5-087e-4076-9527-9337d278fc94 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:13:49.074133 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-1388b6b5-087e-4076-9527-9337d278fc94 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:13:49.074556 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-1388b6b5-087e-4076-9527-9337d278fc94 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:13:49.075260 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-1388b6b5-087e-4076-9527-9337d278fc94 admin admin] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:13:49.075700 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-1388b6b5-087e-4076-9527-9337d278fc94 admin admin] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:13:49.076107 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-1388b6b5-087e-4076-9527-9337d278fc94 admin admin] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:13:49.095702 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-1388b6b5-087e-4076-9527-9337d278fc94 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.084908 Aug 28 10:13:49.096291 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1193 bytes} [Sun Aug 28 10:13:49 2022] GET /compute/v2.1/os-services => generated 791 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 28 10:14:00.343099 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-b0fffffa-e613-4b4c-bc29-f3769e010aa6 admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:14:00.344098 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-b0fffffa-e613-4b4c-bc29-f3769e010aa6 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 28 10:14:00.344496 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 36/73] 10.222.0.40 () {56 vars in 1074 bytes} [Sun Aug 28 10:14:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:14:00.498672 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG dbcounter [-] [105662] Writing DB stats nova_cell0:SELECT=4 {{(pid=105662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:14:00.499362 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG dbcounter [-] [105662] Writing DB stats nova_cell1:SELECT=4 {{(pid=105662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:14:00.500023 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG dbcounter [-] [105662] Writing DB stats nova_api:SELECT=8 {{(pid=105662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:14:00.566732 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-9e342e7c-acfe-471b-ad57-837fc71d99a7 admin admin] Calling method '>' {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:14:00.570120 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-9e342e7c-acfe-471b-ad57-837fc71d99a7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:14:00.570583 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-9e342e7c-acfe-471b-ad57-837fc71d99a7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:14:00.570999 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-9e342e7c-acfe-471b-ad57-837fc71d99a7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:14:00.571686 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-9e342e7c-acfe-471b-ad57-837fc71d99a7 admin admin] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:14:00.572117 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-9e342e7c-acfe-471b-ad57-837fc71d99a7 admin admin] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:14:00.572546 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-9e342e7c-acfe-471b-ad57-837fc71d99a7 admin admin] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:14:00.597397 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-9e342e7c-acfe-471b-ad57-837fc71d99a7 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.103234 Aug 28 10:14:00.597958 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 38/74] 10.222.0.40 () {60 vars in 1193 bytes} [Sun Aug 28 10:14:00 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:14:01.422079 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: DEBUG nova.api.openstack.wsgi [None req-b0fffffa-e613-4b4c-bc29-f3769e010aa6 admin admin] Calling method '>' {{(pid=105663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:14:01.423072 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: INFO nova.api.openstack.requestlog [None req-b0fffffa-e613-4b4c-bc29-f3769e010aa6 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 28 10:14:01.423480 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: [pid: 105663|app: 0|req: 37/75] 10.222.0.40 () {56 vars in 1074 bytes} [Sun Aug 28 10:14:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:14:01.623517 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG nova.api.openstack.wsgi [None req-9df0baa2-a1d9-4cb3-a3e5-91db81bef207 admin admin] Calling method '>' {{(pid=105662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:14:01.626886 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-9df0baa2-a1d9-4cb3-a3e5-91db81bef207 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:14:01.627409 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-9df0baa2-a1d9-4cb3-a3e5-91db81bef207 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:14:01.627829 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-9df0baa2-a1d9-4cb3-a3e5-91db81bef207 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:14:01.628540 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-9df0baa2-a1d9-4cb3-a3e5-91db81bef207 admin admin] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:14:01.629020 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-9df0baa2-a1d9-4cb3-a3e5-91db81bef207 admin admin] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:14:01.629429 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: DEBUG oslo_concurrency.lockutils [None req-9df0baa2-a1d9-4cb3-a3e5-91db81bef207 admin admin] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:14:01.651713 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: INFO nova.api.openstack.requestlog [None req-9df0baa2-a1d9-4cb3-a3e5-91db81bef207 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.089267 Aug 28 10:14:01.652255 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: [pid: 105662|app: 0|req: 39/76] 10.222.0.40 () {60 vars in 1193 bytes} [Sun Aug 28 10:14:01 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:14:59.130138 dv-cinder-852009-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 28 10:14:59.131020 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: Sun Aug 28 10:14:59 2022 - graceful shutdown triggered... Aug 28 10:14:59.131519 dv-cinder-852009-4-iscsi devstack@n-api.service[105662]: Gracefully killing worker 1 (pid: 105662)... Aug 28 10:14:59.131904 dv-cinder-852009-4-iscsi devstack@n-api.service[105663]: Gracefully killing worker 2 (pid: 105663)... Aug 28 10:15:00.131727 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: worker 1 buried after 1 seconds Aug 28 10:15:00.131727 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: worker 2 buried after 1 seconds Aug 28 10:15:00.131727 dv-cinder-852009-4-iscsi devstack@n-api.service[105661]: goodbye to uWSGI. Aug 28 10:15:00.134225 dv-cinder-852009-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 28 10:15:00.135119 dv-cinder-852009-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 28 10:15:00.139679 dv-cinder-852009-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 28 10:15:00.152357 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 28 10:15:00.154531 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 28 10:15:00 2022] *** Aug 28 10:15:00.154531 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 28 10:15:00.154531 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 28 10:15:00.154531 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: nodename: dv-cinder-852009-4-iscsi Aug 28 10:15:00.154531 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: machine: x86_64 Aug 28 10:15:00.154531 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: clock source: unix Aug 28 10:15:00.154531 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: pcre jit disabled Aug 28 10:15:00.154531 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: detected number of CPU cores: 4 Aug 28 10:15:00.154531 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: current working directory: / Aug 28 10:15:00.154531 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: detected binary path: /usr/bin/uwsgi-core Aug 28 10:15:00.154531 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: your processes number limit is 47680 Aug 28 10:15:00.154531 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: your memory page size is 4096 bytes Aug 28 10:15:00.154531 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: detected max file descriptor number: 2048 Aug 28 10:15:00.154531 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: lock engine: pthread robust mutexes Aug 28 10:15:00.155428 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: thunder lock: enabled Aug 28 10:15:00.155428 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 28 10:15:00.155428 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 28 10:15:00.195429 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: Python main interpreter initialized at 0x5636991749c0 Aug 28 10:15:00.195429 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: python threads support enabled Aug 28 10:15:00.195429 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: your server socket listen backlog is limited to 100 connections Aug 28 10:15:00.195429 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: your mercy for graceful operations on workers is 90 seconds Aug 28 10:15:00.195872 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: mapped 403077 bytes (393 KB) for 2 cores Aug 28 10:15:00.195872 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: *** Operational MODE: preforking *** Aug 28 10:15:00.196177 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: *** uWSGI is running in multiple interpreter mode *** Aug 28 10:15:00.196177 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: spawned uWSGI master process (pid: 120648) Aug 28 10:15:00.196418 dv-cinder-852009-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 28 10:15:00.200566 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: spawned uWSGI worker 1 (pid: 120663, cores: 1) Aug 28 10:15:00.200566 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: spawned uWSGI worker 2 (pid: 120664, cores: 1) Aug 28 10:15:00.200566 dv-cinder-852009-4-iscsi devstack@n-api.service[120648]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 28 10:15:00.846559 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 28 10:15:00.847163 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 28 10:15:01.983722 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 10:15:01.983722 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: from cryptography.utils import int_from_bytes Aug 28 10:15:01.984492 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 10:15:01.984492 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: from cryptography.utils import int_from_bytes Aug 28 10:15:01.985243 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 10:15:01.985243 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: from cryptography.utils import int_from_bytes Aug 28 10:15:01.985379 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 10:15:01.985379 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: from cryptography.utils import int_from_bytes Aug 28 10:15:04.380970 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 28 10:15:04.381683 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 28 10:15:04.381779 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 28 10:15:04.382066 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 28 10:15:04.382330 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 28 10:15:04.382697 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.383023 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.383373 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.383691 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.384135 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.384462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.384834 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.385151 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.385475 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.385696 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.385804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 28 10:15:04.386182 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.386286 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 28 10:15:04.386385 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-4-iscsi {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.386616 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 28 10:15:04.386722 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.386902 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 28 10:15:04.387003 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.387166 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 28 10:15:04.387290 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.387506 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.387618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.387805 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.387911 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.388131 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.388242 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.388439 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.388672 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.388944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.390439 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.390709 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.390957 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.391174 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.391381 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.391595 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.391822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.392037 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.392252 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.392559 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.392783 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.393061 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.393309 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.393516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-4-iscsi {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.393733 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.393950 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.394155 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.394359 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.394691 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.394919 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.395132 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.395360 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.395566 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-4-iscsi {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.395759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.395944 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.396124 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.396279 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.396423 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.396630 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.396786 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.396952 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.397105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.397300 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.397454 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.397615 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.397766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.397928 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.398081 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.398231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.398388 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.398537 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.398713 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.398861 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.399032 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.399178 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.402296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.402533 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.402701 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.402850 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.404103 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.404280 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.404451 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-4-iscsi {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.404652 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.404808 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.405000 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.405159 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.405409 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.405560 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.405727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.405727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.406018 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.406171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.406324 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.406476 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.407212 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.407373 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.407530 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.407676 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.407830 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.407975 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.408143 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.408298 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.408455 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.408720 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.408877 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.409030 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.409175 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.409325 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.409821 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.410003 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.410161 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.410979 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.411143 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.411292 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.411451 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.411603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.411603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.411924 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.412079 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.412231 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.412394 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.412619 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.412619 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.413672 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.413877 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.414071 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.414577 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.414731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.414877 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.415027 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.415171 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.415332 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.415484 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.415629 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.415783 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.415941 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.416109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.416603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.416759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.416916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.417062 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.417213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.417375 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.417532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.417677 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.417828 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.417973 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.418123 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.418293 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.418450 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.418601 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.418745 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.418897 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.419087 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.419247 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.419391 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.419534 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.419989 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.420142 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.420286 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.420444 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.420676 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.420830 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.420975 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.421119 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.421262 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.421262 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.421550 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.421550 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.421834 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.421987 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.422144 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.422300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.422445 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.422650 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.422811 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.422811 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.423104 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.423262 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.423414 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.423576 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.423866 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.424023 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.424178 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.424323 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.424473 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.424659 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.424823 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.424977 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.425137 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.425289 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.425434 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.425587 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.425737 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.425891 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.426034 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.426178 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.426347 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.426749 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.426912 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.427072 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.427225 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.427378 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.427523 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.427673 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.427817 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.427988 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.428654 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.428823 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.428979 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.429132 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.429286 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.429450 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.429596 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.429739 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.430167 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.430320 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.430471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.430617 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.430770 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.430914 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.431073 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.431252 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.431623 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.432318 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.432494 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.432731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.432883 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.433028 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.433188 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.433334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.433478 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.433631 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.433802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.434090 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.434242 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.434396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.434549 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.434718 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.434866 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.435017 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.435017 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.435301 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.435443 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.435586 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.435736 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.435889 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.436041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.436198 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.436343 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.436493 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.436687 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.436942 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.437097 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.437242 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.437489 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.437633 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.437782 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.437937 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.438084 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.438225 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.438374 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.438517 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.438678 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.438900 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.439045 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.439192 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.439192 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.439470 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.439616 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.439769 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.439917 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.440279 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.440420 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.440609 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.440775 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.440939 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.441086 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.441237 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.441388 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.441571 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.441738 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.441891 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.442043 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.442196 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.442340 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.442483 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.442639 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.442839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.443014 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.443177 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.443322 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.443487 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.443641 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.443785 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.443928 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:15:04.444245 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.444398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.444575 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.444728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.444879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.445042 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.445195 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.445340 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.445492 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.445637 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.445788 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.445939 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.446090 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.446249 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.446410 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.446565 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.446710 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.446854 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.447115 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.447266 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.447412 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.447672 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.447824 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.448228 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.448380 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.448573 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.448732 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.448886 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.449039 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.449184 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.449338 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.449505 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.449664 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.449810 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.449955 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.450126 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.450466 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.450627 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.450786 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.450786 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.451067 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.451067 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.451346 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.451513 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.451513 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.452302 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.452468 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.452656 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.452810 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.452998 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.453164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.453311 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.453462 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.453607 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.454348 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.454517 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.454677 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.454830 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.454986 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.455138 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.455412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.455586 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.455735 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.455879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.456023 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.456167 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.456311 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.456464 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.456677 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.456846 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.456999 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.457168 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.457445 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.457616 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.457762 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.457908 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.458062 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.458233 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.458467 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.458626 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.458778 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.458930 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.459087 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.459239 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.459393 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.459551 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.459704 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.459855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.460001 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.460001 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.460525 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.460525 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.460833 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.460980 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.461136 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.461280 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.461437 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.461582 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.461733 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.461877 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.462034 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.462187 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.462345 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.462345 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.462625 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.462776 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.462920 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.463135 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.463291 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.463444 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.463595 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.463740 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.463890 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.464050 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.464197 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.464498 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.464671 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.464817 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.464961 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.465121 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.465279 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.465424 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.465567 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.465710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.465862 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.466021 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.466166 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.466311 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.466463 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.466610 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.466767 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.466921 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.467072 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.467241 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.467387 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.467633 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.467871 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.468018 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.468170 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.468324 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.468529 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.468775 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.468944 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.469098 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.469243 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.469399 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.469543 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.469688 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.469845 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.469997 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.470151 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.470304 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.470662 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.470823 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.471222 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.471372 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.471518 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.471663 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.471818 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.471971 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.472123 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.472269 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.472413 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.472577 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.472737 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.472939 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.473140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.473292 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.473435 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.473580 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.473733 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.473902 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.474047 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.474192 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.474336 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.474647 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.474813 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.474959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.475112 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.475264 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.475424 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.475578 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.475733 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.475893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.475893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.476188 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.476333 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.476476 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.476655 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.476810 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.476963 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.477116 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.477260 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.477410 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.477568 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.477823 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.477992 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.478139 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.478283 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.478443 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.478587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.478740 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.478987 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.479142 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.479294 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.479454 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.479599 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.479743 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.479887 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.480042 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.480186 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.480361 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.481183 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.481355 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.481509 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.481664 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.481809 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.481969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.482123 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.482344 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.482504 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.482658 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.482824 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.482989 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.483152 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.483338 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.483491 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.483644 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.483803 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.483956 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.484101 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.484245 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.484388 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.484562 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.484882 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.485052 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.485199 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.485351 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.485504 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.485647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.485804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.485950 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.486094 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.486237 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.486387 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.486538 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.486694 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.486839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.486992 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.487135 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.487286 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.487440 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.487585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.487728 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.487979 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.488130 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.488276 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.488461 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.488653 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.488799 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.488951 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.489221 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.489383 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.489538 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.490287 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.490455 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.490603 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.490979 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.491134 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.491279 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.491432 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.491615 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.491773 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.491925 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.492076 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.492227 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.492379 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.492620 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.492773 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.492918 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.493093 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.493240 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.493442 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.493647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.493810 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.493955 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.494100 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.494251 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.494454 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.494604 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.494757 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.495106 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.495257 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.495409 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.495565 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.495710 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.495861 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.496016 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.496167 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.496311 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.496472 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.496655 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.496801 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.496944 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.497102 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.497247 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.497399 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.497551 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.497696 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.497840 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.498011 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.498271 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.498433 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.498587 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.498732 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.498884 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.499037 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.499286 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.499544 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.499544 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.499544 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.499544 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.499544 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.500267 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.500421 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.500652 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.501049 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.501212 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.501366 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.501520 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.501672 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.501817 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.501970 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.502116 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.502267 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.502421 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.502577 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.502987 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.503143 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.503288 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.503488 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.503647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.503800 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.503974 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.504345 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.504518 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.504518 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.504815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.504976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.505338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.505488 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.505579 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.505673 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.505769 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.505856 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.505948 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.506034 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.506120 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.506120 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.506292 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.506378 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.506471 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.506556 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.506649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.506734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.506840 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.506840 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.507007 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.507007 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.507185 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.507273 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.507357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.507499 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.507499 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.507658 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.507758 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.507846 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.507931 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.508022 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.508115 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.508210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.508369 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.508465 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.508600 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.508732 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.508824 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.508919 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.509012 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.509106 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.509201 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.509300 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.509300 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.509464 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.509568 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.509662 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.509757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.509757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.509921 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.510005 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.510088 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.510171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.510268 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.510355 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.510439 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.510439 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.510439 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.510439 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.510775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.510862 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.511218 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.511329 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.511417 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.511509 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.511601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.511686 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.511686 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.511848 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.511934 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.512018 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.512102 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.512186 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.512270 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.512362 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.512454 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.512627 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.512773 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.512911 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.513046 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.513185 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.513323 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.513323 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.513585 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.513674 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.513767 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.513867 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.513963 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.514056 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.514206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.514297 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.514395 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.514482 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.514575 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.514668 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.514761 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.514856 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.514954 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.515047 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.515141 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.515296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.515387 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.515479 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.515578 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.515672 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.515767 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.515767 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.515935 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.516072 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.516161 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.516252 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.516337 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.516420 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.516634 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.516752 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.516850 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.516944 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.517031 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.517115 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.517208 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.517302 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.517388 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.517483 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.517569 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.517706 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.517803 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.517897 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.517897 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.517897 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.518139 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.518225 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.518319 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.518411 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.518496 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.518586 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.518718 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.518815 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.518911 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.518997 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.519090 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.519251 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.519342 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.519432 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.519531 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.519668 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.519759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.519844 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.519927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.520012 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.520106 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.520193 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.520283 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.520367 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.520450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.520639 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.520750 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.520837 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.520923 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.521007 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.521106 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.521428 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.521536 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.521624 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.521708 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.521800 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.521886 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.521984 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.522070 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.522162 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.522254 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.522346 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.522444 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.522539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.522634 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.522727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.522819 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.522905 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.523001 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.523087 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.523171 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.523255 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.523382 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.523482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.523629 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.523725 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.523821 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.523913 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.524005 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.524100 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.524194 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.524280 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.524365 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.524449 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.524551 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.524651 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.524747 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.524843 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.524929 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.525020 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.525105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.525270 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.525406 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.525495 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.525581 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.525664 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.525747 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.525840 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.525933 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.526061 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.526196 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.526289 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.526373 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.526471 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.526556 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.526639 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.527479 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.527605 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.527728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.527851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.527972 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.528094 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.528222 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.528341 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.528463 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.528602 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.528715 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.528826 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.528958 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.529080 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.529202 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.529315 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.529425 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.529543 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.529659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.529772 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.529892 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.530005 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.530115 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.530226 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.530336 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.530450 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.530574 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.530687 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.530815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.530936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.531047 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.531141 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.531238 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.531564 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.531750 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.531843 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.531929 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.532061 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.532200 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.532306 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.532401 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.532494 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.532734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.532835 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.532922 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.533019 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.533105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.533188 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.533280 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.533383 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.533517 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.533681 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.533807 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.533920 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.533920 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.534096 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.534183 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.534275 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.534407 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.534579 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.534679 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.534773 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.534859 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.534942 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.535025 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.535109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.535229 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.535318 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.535411 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.535485 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.535562 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.535647 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.535743 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.535838 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.535924 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.536007 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.536090 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.536173 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.536273 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.536359 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.536450 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.536567 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.536672 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.536766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.536766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.536972 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.536972 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.536972 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.536972 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.536972 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.537347 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.537439 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.537525 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.537609 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.537700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.537700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.537700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.537700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.538013 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.538098 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.538189 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.538288 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.538374 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.538457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.538548 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.538634 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.538731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.538816 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.538908 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.539000 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.539095 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.539529 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.539630 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.539715 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.539799 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.539890 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.539975 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.540072 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.540168 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.540254 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.540338 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.540338 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.540491 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.540610 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.540709 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.540804 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.540897 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.540989 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.541077 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.541077 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.541271 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.541371 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.541652 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.541746 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.541834 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.542503 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.542596 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.542693 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.542787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.542881 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.542971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.543070 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.543165 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.543259 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.543345 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.543429 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.543513 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.543649 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.543795 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.543897 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.543984 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.544077 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.544182 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.544282 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.544379 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.544379 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.544566 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.544665 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.544753 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.544838 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.544922 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.545014 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.545109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.545196 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.545283 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.545366 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.545465 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.545592 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.545695 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.545790 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.545885 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.545885 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.546048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.546139 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.546233 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.546319 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.546410 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.546638 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.546730 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.546955 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.547058 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.547255 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.547355 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.547560 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.547660 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.547870 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.547963 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.548181 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.548325 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.548487 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.548625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.548825 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.548945 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.549131 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.549250 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.549439 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.549569 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.549746 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.549893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.550054 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.550219 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.550356 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.550524 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.550659 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.550849 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.551050 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.551200 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.551345 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.551508 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.551725 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.551872 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.551972 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.552111 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.552265 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.552418 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.552626 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.552788 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.552910 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.553101 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.553231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.553407 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.553539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.553712 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.553851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.554017 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.554134 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.554341 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.554436 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.554647 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.554761 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.554968 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.555071 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.555282 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.555407 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.555606 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.555706 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.555928 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.556040 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.556233 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.556326 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.556587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.556684 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.556899 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.557008 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.557206 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.557301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.557509 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.557610 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.557813 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.557920 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.558141 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.558232 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.558445 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.558557 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.558759 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.558861 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.559068 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.559160 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.559369 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.559460 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.559676 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.559790 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.559987 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.560093 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.560289 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.560399 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.560615 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.560718 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.560920 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.561021 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.561243 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.561345 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.561545 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.561680 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.561912 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.562034 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.562169 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.562291 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.562473 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.562566 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.562777 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.562878 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.563078 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.563180 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.563387 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.563480 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.563692 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.563787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.563997 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.564109 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.564303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.564396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.564647 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.564758 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.564956 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.565063 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.565278 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.565370 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.565586 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.565688 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.565895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.565997 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.566199 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.566291 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.566530 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.566626 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.566841 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.566943 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.567146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.567238 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.567460 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.567552 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.567772 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.567865 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.568086 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.568181 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.568402 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.568672 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.568787 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.569005 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.569099 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.569318 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.569411 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.569628 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.569722 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.569938 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.570031 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.570251 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.570342 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.570561 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.570668 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.570871 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.570975 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.571177 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.571287 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.571482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.571583 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.571788 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.572034 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.572141 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.572366 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.572475 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.572709 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.572809 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.573022 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.573114 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.573334 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.573435 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.573651 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.573742 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.573980 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.574086 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.574270 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.574379 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.574578 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.574669 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.574887 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.574988 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.575198 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.575295 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.575509 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.575605 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.575826 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.576006 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.576155 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.576306 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.576449 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.576643 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.576803 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.576954 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.577097 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.577238 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.577385 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.577483 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.577644 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.577748 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.577979 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.578062 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.578365 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.578676 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.578989 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.579308 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.579627 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.579940 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.580251 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.580595 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.580863 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.581026 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.581207 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.581399 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.581635 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.581804 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.582404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.582603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.582797 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.582960 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.582960 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.583328 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.583484 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.583637 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.583789 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.583940 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.583940 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.584238 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.584398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.584581 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.584751 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.584911 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.585072 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.585224 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.585375 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.585533 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.585686 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.585846 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.586011 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.586182 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.586335 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.586493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.586645 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.586820 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.587569 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.587725 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.587887 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.588047 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.588209 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.588361 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.588555 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.588715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.588866 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.589022 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.589185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.589185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.589487 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.589487 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.589780 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.589780 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.590090 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.590250 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.590401 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.590551 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.590551 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.590856 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.590856 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.591166 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.591325 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.591484 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.591661 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.591836 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.591996 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.592568 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.592746 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.592916 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.593084 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.593247 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.593406 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.593568 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.593738 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.593898 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.594056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.594218 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.594379 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.594531 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.594681 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.594840 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.594992 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.595158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.595310 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.595469 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.595622 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.595793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.595955 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.596124 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.596277 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.596435 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.596635 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.596788 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.596963 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.597125 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.597277 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.597435 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.597612 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.597740 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.597851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.597944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.598042 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.598131 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.598223 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.598317 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.598412 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.598505 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.598590 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.598716 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.598805 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.598903 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.598989 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.599081 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.599165 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.599249 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.599338 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.599436 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.599522 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.599612 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.599703 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.599817 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.599990 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.600133 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.600298 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.600427 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.600635 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.600757 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.600994 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.601101 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.601319 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.601412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.601629 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.601739 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.601936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.602046 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.602256 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.602382 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.602569 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.602664 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.602884 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.602979 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.603197 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.603287 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.603510 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.603600 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.603822 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.603923 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.604156 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.604378 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.604481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.604735 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.605020 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.605115 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.605355 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.605454 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.605679 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.605784 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.606010 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.606100 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.606318 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.606429 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.606621 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.606723 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.606926 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.607018 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.607232 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.607371 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.607544 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.607698 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.607854 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.607954 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.608163 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.608254 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.608474 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.608592 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.608806 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.608896 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.609117 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.609216 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.609424 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.609524 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.609732 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.609824 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.610037 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.610134 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.610342 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.610433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.610646 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.610737 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.610952 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.611045 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.611259 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.611351 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.611564 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.611663 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.611872 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.612052 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.612183 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.612275 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.612544 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.612693 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.612849 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.612976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.613162 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.613253 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.613528 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.613630 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.613838 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.613938 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.614146 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.614291 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.614495 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.614612 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.614748 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.614841 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.615056 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.615148 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.615372 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.615463 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.615686 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.615812 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.615989 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.616081 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.616292 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.616444 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.616735 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.616837 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.617048 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.617147 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.617367 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.617469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.617674 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.617817 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.617984 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.618082 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.618307 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.618418 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.618616 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.618707 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.618929 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.619018 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.619250 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.619360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.619566 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.619658 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.619894 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.619999 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.620217 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.620317 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.620559 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.620667 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.620865 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.620956 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.621167 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.621260 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.621468 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.621572 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.621772 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.621863 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.622080 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.622182 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.622387 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.622480 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.622687 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.622791 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.622988 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.623111 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.623290 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.623390 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.623590 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.623689 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.623890 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.623982 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.624189 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.624279 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.624493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.624655 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.624820 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.624924 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.625115 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.625206 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.625413 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.625517 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.625713 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.625803 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.626013 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.626104 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.626311 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.626403 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.626609 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.626701 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.626910 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.626999 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.627209 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.627315 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.627506 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.627606 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.627805 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.627948 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.628103 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.628203 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.628402 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.628492 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.628731 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.628832 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.629087 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.629183 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.629401 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.629490 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.629723 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.629829 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.630036 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.630164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.630346 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.630444 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.630652 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.630754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.630960 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.631137 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.631281 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.631375 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.631593 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.631695 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.631907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.632116 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.632235 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.632439 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.632570 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.632789 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.632898 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.633239 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.633338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.633422 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.633507 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.633916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.634011 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.634084 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.634155 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.634225 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.634319 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.634698 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.634796 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.634872 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.634944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.635189 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.635293 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.635472 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.635564 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.635785 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.635884 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.636105 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.636211 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.636421 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.636547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.636776 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.636890 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.637107 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.637210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.637421 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.637521 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.637731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.637833 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.638057 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.638165 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.638351 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.638453 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.638661 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.638777 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.638976 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.639076 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.639285 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.639387 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.639594 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.639710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.639910 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.640011 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.640226 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.640341 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.640571 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.640780 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.640881 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.640970 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.641195 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.641297 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.641516 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.641620 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.641840 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.641931 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.642193 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.642330 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.642492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.642584 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.642833 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.642965 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.643158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.643256 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.643469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.643563 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.643780 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.643871 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.644083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.644172 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:15:04.644326 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 28 10:15:04.644426 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 28 10:15:04.705835 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO dbcounter [None req-c2b6fad8-e26f-49bb-b910-1d736e1d83df None None] Registered counter for database nova_api Aug 28 10:15:04.706757 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO dbcounter [None req-687f67bc-7e39-4158-847c-58d21fcd0939 None None] Registered counter for database nova_api Aug 28 10:15:04.727277 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_db.sqlalchemy.engines [None req-687f67bc-7e39-4158-847c-58d21fcd0939 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 10:15:04.728921 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_db.sqlalchemy.engines [None req-c2b6fad8-e26f-49bb-b910-1d736e1d83df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120664) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 10:15:04.733934 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writer thread running {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 10:15:04.736028 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writer thread running {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 10:15:04.789540 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.context [None req-687f67bc-7e39-4158-847c-58d21fcd0939 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),72a19395-589c-4f4b-90cf-8b271a69d910(cell1) {{(pid=120663) load_cells /opt/stack/nova/nova/context.py:464}} Aug 28 10:15:04.793600 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-687f67bc-7e39-4158-847c-58d21fcd0939 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:15:04.794072 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-687f67bc-7e39-4158-847c-58d21fcd0939 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:15:04.794188 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.context [None req-c2b6fad8-e26f-49bb-b910-1d736e1d83df None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),72a19395-589c-4f4b-90cf-8b271a69d910(cell1) {{(pid=120664) load_cells /opt/stack/nova/nova/context.py:464}} Aug 28 10:15:04.795637 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-687f67bc-7e39-4158-847c-58d21fcd0939 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:15:04.796367 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-687f67bc-7e39-4158-847c-58d21fcd0939 None None] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:15:04.796840 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-687f67bc-7e39-4158-847c-58d21fcd0939 None None] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:15:04.798153 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c2b6fad8-e26f-49bb-b910-1d736e1d83df None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:15:04.798620 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c2b6fad8-e26f-49bb-b910-1d736e1d83df None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:15:04.798818 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-687f67bc-7e39-4158-847c-58d21fcd0939 None None] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:15:04.800596 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c2b6fad8-e26f-49bb-b910-1d736e1d83df None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:15:04.800929 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO dbcounter [None req-687f67bc-7e39-4158-847c-58d21fcd0939 None None] Registered counter for database nova_cell0 Aug 28 10:15:04.801402 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c2b6fad8-e26f-49bb-b910-1d736e1d83df None None] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:15:04.801847 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c2b6fad8-e26f-49bb-b910-1d736e1d83df None None] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:15:04.803841 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c2b6fad8-e26f-49bb-b910-1d736e1d83df None None] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:15:04.804957 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO dbcounter [None req-687f67bc-7e39-4158-847c-58d21fcd0939 None None] Registered counter for database nova_cell1 Aug 28 10:15:04.805871 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO dbcounter [None req-c2b6fad8-e26f-49bb-b910-1d736e1d83df None None] Registered counter for database nova_cell0 Aug 28 10:15:04.809839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO dbcounter [None req-c2b6fad8-e26f-49bb-b910-1d736e1d83df None None] Registered counter for database nova_cell1 Aug 28 10:15:04.812535 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_db.sqlalchemy.engines [None req-687f67bc-7e39-4158-847c-58d21fcd0939 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 10:15:04.814275 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_db.sqlalchemy.engines [None req-687f67bc-7e39-4158-847c-58d21fcd0939 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 10:15:04.817444 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_db.sqlalchemy.engines [None req-c2b6fad8-e26f-49bb-b910-1d736e1d83df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120664) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 10:15:04.818761 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_db.sqlalchemy.engines [None req-c2b6fad8-e26f-49bb-b910-1d736e1d83df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120664) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 10:15:04.821143 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writer thread running {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 10:15:04.823592 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writer thread running {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 10:15:04.825283 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writer thread running {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 10:15:04.827405 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writer thread running {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 10:15:04.968293 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO dbcounter [None req-687f67bc-7e39-4158-847c-58d21fcd0939 None None] Registered counter for database nova_cell0 Aug 28 10:15:04.973478 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO dbcounter [None req-c2b6fad8-e26f-49bb-b910-1d736e1d83df None None] Registered counter for database nova_cell0 Aug 28 10:15:04.975130 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_db.sqlalchemy.engines [None req-687f67bc-7e39-4158-847c-58d21fcd0939 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 10:15:04.979753 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writer thread running {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 10:15:04.980298 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_db.sqlalchemy.engines [None req-c2b6fad8-e26f-49bb-b910-1d736e1d83df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120664) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 10:15:04.984873 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writer thread running {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 10:15:05.289999 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: WARNING keystonemiddleware.auth_token [None req-687f67bc-7e39-4158-847c-58d21fcd0939 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 28 10:15:05.297306 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: WARNING keystonemiddleware.auth_token [None req-687f67bc-7e39-4158-847c-58d21fcd0939 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 28 10:15:05.297447 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: WARNING keystonemiddleware.auth_token [None req-c2b6fad8-e26f-49bb-b910-1d736e1d83df None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 28 10:15:05.304697 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: WARNING keystonemiddleware.auth_token [None req-c2b6fad8-e26f-49bb-b910-1d736e1d83df None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 28 10:15:05.639651 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: WARNING keystonemiddleware.auth_token [None req-687f67bc-7e39-4158-847c-58d21fcd0939 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 28 10:15:05.645742 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: WARNING keystonemiddleware.auth_token [None req-687f67bc-7e39-4158-847c-58d21fcd0939 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 28 10:15:05.650499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: WARNING keystonemiddleware.auth_token [None req-c2b6fad8-e26f-49bb-b910-1d736e1d83df None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 28 10:15:05.651047 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5636991749c0 pid: 120663 (default app) Aug 28 10:15:05.657237 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: WARNING keystonemiddleware.auth_token [None req-c2b6fad8-e26f-49bb-b910-1d736e1d83df None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 28 10:15:05.662659 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5636991749c0 pid: 120664 (default app) Aug 28 10:15:40.782675 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:15:40.783670 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:15:40.784555 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:15:40.785298 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:15:42.457648 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-12f2cc88-3c78-45df-9d3a-0e650d77c9ad tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] Action: 'create', calling method: .version_select at 0x7f7a1d177040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-201451596", "metadata": {"Type": "work"}}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:15:42.465907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-12f2cc88-3c78-45df-9d3a-0e650d77c9ad tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] Request method failure captured: Aug 28 10:15:42.465907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 28 10:15:42.465907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:15:42.465907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:15:42.465907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:15:42.465907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 121 Aug 28 10:15:42.465907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:15:42.465907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:15:42.465907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:15:42.465907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:15:42.465907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0BMh7ciSd-cx9t3NrcdOSyY4ccW-v62fc0wGlmO0l-kRq9GH-et6JvsOirWfS1WgjmU3SITA3sNEjWqEOHxjYnEIi2ccZga5CjsKxtBY069pfCg94J3EFUFqFuuDLXhgMEYDfYT6hMeyrcAGCSv7WStnsuC7pVhMxWPThWJPPP3IwE Aug 28 10:15:42.465907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:15:42.465907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:15:42.465907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:15:42.465907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:15:42.465907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:15:42.465907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:15:42.465907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 7d83a21ea63d41909cb369f94cf3a3cc Aug 28 10:15:42.465907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesNegativeTest-695646803 Aug 28 10:15:42.465907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:15:42.465907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:15:42.467581 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7d83a21ea63d41909cb369f94cf3a3cc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7d83a21ea63d41909cb369f94cf3a3cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7d83a21ea63d41909cb369f94cf3a3cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7d83a21ea63d41909cb369f94cf3a3cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:15:42.467581 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesNegativeTest-695646803 Aug 28 10:15:42.467581 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 7d83a21ea63d41909cb369f94cf3a3cc Aug 28 10:15:42.467581 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesNegativeTest-695646803 Aug 28 10:15:42.467581 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesNegativeTest-695646803-project Aug 28 10:15:42.467581 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:15:42.467581 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:15:42.467581 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: af1daf846ccd46f1819ba0010875c33b Aug 28 10:15:42.467581 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesNegativeTest-695646803-project Aug 28 10:15:42.467581 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Aug 28 10:15:42.467581 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-201451596", "metadata": {"Type": "work"}}} Aug 28 10:15:42.467581 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: Aug 28 10:15:42.467581 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 28 10:15:42.468562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-201451596', 'metadata': {'Type': 'work'}}}} Aug 28 10:15:42.468562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:15:42.468562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:15:42.468562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 28 10:15:42.468562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 28 10:15:42.468562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 10:15:42.468562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise error Aug 28 10:15:42.468562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 28 10:15:42.468562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:15:42.468562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 28 10:15:42.468562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 28 10:15:42.468562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:15:42.468562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 28 10:15:42.468562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi '#$%' Aug 28 10:15:42.468562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:15:42.468562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:15:42.468562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:15:42.468562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:15:42.468562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:15:42.468562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:15:42.468562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:15:42.468562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:15:42.470105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 28 10:15:42.470105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 28 10:15:42.470105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:15:42.470105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:15:42.470105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 28 10:15:42.470105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 28 10:15:42.470105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 28 10:15:42.470105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 28 10:15:42.470105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 28 10:15:42.470105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 28 10:15:42.470105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 28 10:15:42.470105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:15:42.470105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:15:42.470105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:15:42.470105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:15:42.470105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:15:42.470105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:15:42.470105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 28 10:15:42.470105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 28 10:15:42.471552 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 28 10:15:42.471552 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:15:42.473199 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-12f2cc88-3c78-45df-9d3a-0e650d77c9ad tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:15:42.474803 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-12f2cc88-3c78-45df-9d3a-0e650d77c9ad tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.713690 Aug 28 10:15:42.479812 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 1/1] 10.222.0.40 () {60 vars in 1156 bytes} [Sun Aug 28 10:15:40 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1720 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 28 10:15:42.487568 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=3 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:15:42.488409 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=3 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:15:42.489197 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=3 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:15:42.491088 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=3 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:15:43.004669 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-0322e372-137b-4ba9-8628-08ba790473d3 tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] Action: 'create', calling method: .version_select at 0x7f7a1d242c10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-616957330", "metadata": {"Type": "work"}}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:15:43.024146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-0322e372-137b-4ba9-8628-08ba790473d3 tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] Request method failure captured: Aug 28 10:15:43.024146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 28 10:15:43.024146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:15:43.024146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:15:43.024146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:15:43.024146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 119 Aug 28 10:15:43.024146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:15:43.024146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:15:43.024146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:15:43.024146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:15:43.024146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0BMh7ciSd-cx9t3NrcdOSyY4ccW-v62fc0wGlmO0l-kRq9GH-et6JvsOirWfS1WgjmU3SITA3sNEjWqEOHxjYnEIi2ccZga5CjsKxtBY069pfCg94J3EFUFqFuuDLXhgMEYDfYT6hMeyrcAGCSv7WStnsuC7pVhMxWPThWJPPP3IwE Aug 28 10:15:43.024146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:15:43.024146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:15:43.024146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:15:43.024146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:15:43.024146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:15:43.024146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:15:43.024146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: 7d83a21ea63d41909cb369f94cf3a3cc Aug 28 10:15:43.024146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-VolumesNegativeTest-695646803 Aug 28 10:15:43.024146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:15:43.024146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:15:43.025777 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7d83a21ea63d41909cb369f94cf3a3cc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7d83a21ea63d41909cb369f94cf3a3cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7d83a21ea63d41909cb369f94cf3a3cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7d83a21ea63d41909cb369f94cf3a3cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:15:43.025777 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-VolumesNegativeTest-695646803 Aug 28 10:15:43.025777 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: 7d83a21ea63d41909cb369f94cf3a3cc Aug 28 10:15:43.025777 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-VolumesNegativeTest-695646803 Aug 28 10:15:43.025777 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-VolumesNegativeTest-695646803-project Aug 28 10:15:43.025777 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:15:43.025777 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:15:43.025777 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: af1daf846ccd46f1819ba0010875c33b Aug 28 10:15:43.025777 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-VolumesNegativeTest-695646803-project Aug 28 10:15:43.025777 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Aug 28 10:15:43.025777 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-616957330", "metadata": {"Type": "work"}}} Aug 28 10:15:43.025777 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: Aug 28 10:15:43.025777 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 28 10:15:43.026499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-616957330', 'metadata': {'Type': 'work'}}}} Aug 28 10:15:43.026499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:15:43.026499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:15:43.026499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 28 10:15:43.026499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 28 10:15:43.026499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 10:15:43.026499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise error Aug 28 10:15:43.026499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 28 10:15:43.026499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:15:43.026499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 28 10:15:43.026499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 28 10:15:43.026499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:15:43.026499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 28 10:15:43.026499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi '0' Aug 28 10:15:43.026499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:15:43.026499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:15:43.026499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:15:43.026499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:15:43.026499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:15:43.026499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:15:43.026499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:15:43.026499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:15:43.028352 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 28 10:15:43.028352 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 28 10:15:43.028352 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:15:43.028352 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:15:43.028352 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 28 10:15:43.028352 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 28 10:15:43.028352 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 28 10:15:43.028352 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 28 10:15:43.028352 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 28 10:15:43.028352 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 28 10:15:43.028352 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 28 10:15:43.028352 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:15:43.028352 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:15:43.028352 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:15:43.028352 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:15:43.028352 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:15:43.028352 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:15:43.028352 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 28 10:15:43.028352 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 28 10:15:43.030848 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 28 10:15:43.030848 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:15:43.030848 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-0322e372-137b-4ba9-8628-08ba790473d3 tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:15:43.030848 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-0322e372-137b-4ba9-8628-08ba790473d3 tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.544763 Aug 28 10:15:43.030848 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 1/2] 10.222.0.40 () {60 vars in 1156 bytes} [Sun Aug 28 10:15:42 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 548 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 28 10:15:43.040421 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7022036e-1ea1-4f38-b4f1-18e967ca2363 tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] Action: 'create', calling method: .version_select at 0x7f7a1d177d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2028764410", "metadata": {"Type": "work"}}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:15:43.044072 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7022036e-1ea1-4f38-b4f1-18e967ca2363 tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] Request method failure captured: Aug 28 10:15:43.044072 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 28 10:15:43.044072 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:15:43.044072 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:15:43.044072 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:15:43.044072 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 119 Aug 28 10:15:43.044072 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:15:43.044072 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:15:43.044072 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:15:43.044072 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:15:43.044072 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0BMh7ciSd-cx9t3NrcdOSyY4ccW-v62fc0wGlmO0l-kRq9GH-et6JvsOirWfS1WgjmU3SITA3sNEjWqEOHxjYnEIi2ccZga5CjsKxtBY069pfCg94J3EFUFqFuuDLXhgMEYDfYT6hMeyrcAGCSv7WStnsuC7pVhMxWPThWJPPP3IwE Aug 28 10:15:43.044072 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:15:43.044072 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:15:43.044072 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:15:43.044072 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:15:43.044072 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:15:43.044072 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:15:43.044072 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 7d83a21ea63d41909cb369f94cf3a3cc Aug 28 10:15:43.044072 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesNegativeTest-695646803 Aug 28 10:15:43.044072 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:15:43.044072 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:15:43.045460 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7d83a21ea63d41909cb369f94cf3a3cc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7d83a21ea63d41909cb369f94cf3a3cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7d83a21ea63d41909cb369f94cf3a3cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7d83a21ea63d41909cb369f94cf3a3cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:15:43.045460 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesNegativeTest-695646803 Aug 28 10:15:43.045460 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 7d83a21ea63d41909cb369f94cf3a3cc Aug 28 10:15:43.045460 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesNegativeTest-695646803 Aug 28 10:15:43.045460 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesNegativeTest-695646803-project Aug 28 10:15:43.045460 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:15:43.045460 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:15:43.045460 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: af1daf846ccd46f1819ba0010875c33b Aug 28 10:15:43.045460 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesNegativeTest-695646803-project Aug 28 10:15:43.045460 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Aug 28 10:15:43.045460 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2028764410", "metadata": {"Type": "work"}}} Aug 28 10:15:43.045460 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: Aug 28 10:15:43.045460 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 28 10:15:43.046410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2028764410', 'metadata': {'Type': 'work'}}}} Aug 28 10:15:43.046410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:15:43.046410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:15:43.046410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 28 10:15:43.046410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 28 10:15:43.046410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 10:15:43.046410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise error Aug 28 10:15:43.046410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 28 10:15:43.046410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:15:43.046410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 28 10:15:43.046410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 28 10:15:43.046410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:15:43.046410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 28 10:15:43.046410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi '' Aug 28 10:15:43.046410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:15:43.046410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:15:43.046410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:15:43.046410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:15:43.046410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:15:43.046410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:15:43.046410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:15:43.046410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:15:43.047644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 28 10:15:43.047644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 28 10:15:43.047644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:15:43.047644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:15:43.047644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 28 10:15:43.047644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 28 10:15:43.047644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 28 10:15:43.047644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 28 10:15:43.047644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 28 10:15:43.047644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 28 10:15:43.047644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 28 10:15:43.047644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:15:43.047644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:15:43.047644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:15:43.047644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:15:43.047644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:15:43.047644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:15:43.047644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 28 10:15:43.047644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 28 10:15:43.049259 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 28 10:15:43.049259 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:15:43.049259 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7022036e-1ea1-4f38-b4f1-18e967ca2363 tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:15:43.049259 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7022036e-1ea1-4f38-b4f1-18e967ca2363 tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010896 Aug 28 10:15:43.055550 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 2/3] 10.222.0.40 () {60 vars in 1156 bytes} [Sun Aug 28 10:15:43 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 28 10:15:43.062904 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-3995cb47-2a5a-47d8-b7b1-f337c6515d63 tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] Calling method '.version_select at 0x7f7a1d2623a0>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:15:44.352324 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-3995cb47-2a5a-47d8-b7b1-f337c6515d63 tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] HTTP exception thrown: Volume tempest-invalid-1257962568 could not be found. Aug 28 10:15:44.357446 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-3995cb47-2a5a-47d8-b7b1-f337c6515d63 tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] Request method failure captured: Aug 28 10:15:44.357446 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1257962568 HTTP/1.1 Aug 28 10:15:44.357446 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:15:44.357446 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:15:44.357446 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:15:44.357446 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:15:44.357446 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:15:44.357446 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:15:44.357446 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:15:44.357446 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:15:44.357446 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0BMh7ciSd-cx9t3NrcdOSyY4ccW-v62fc0wGlmO0l-kRq9GH-et6JvsOirWfS1WgjmU3SITA3sNEjWqEOHxjYnEIi2ccZga5CjsKxtBY069pfCg94J3EFUFqFuuDLXhgMEYDfYT6hMeyrcAGCSv7WStnsuC7pVhMxWPThWJPPP3IwE Aug 28 10:15:44.357446 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:15:44.357446 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:15:44.357446 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:15:44.357446 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:15:44.357446 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:15:44.357446 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:15:44.357446 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: 7d83a21ea63d41909cb369f94cf3a3cc Aug 28 10:15:44.357446 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-VolumesNegativeTest-695646803 Aug 28 10:15:44.357446 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:15:44.357446 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:15:44.359131 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7d83a21ea63d41909cb369f94cf3a3cc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7d83a21ea63d41909cb369f94cf3a3cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7d83a21ea63d41909cb369f94cf3a3cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7d83a21ea63d41909cb369f94cf3a3cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:15:44.359131 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-VolumesNegativeTest-695646803 Aug 28 10:15:44.359131 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: 7d83a21ea63d41909cb369f94cf3a3cc Aug 28 10:15:44.359131 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-VolumesNegativeTest-695646803 Aug 28 10:15:44.359131 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-VolumesNegativeTest-695646803-project Aug 28 10:15:44.359131 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:15:44.359131 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:15:44.359131 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: af1daf846ccd46f1819ba0010875c33b Aug 28 10:15:44.359131 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-VolumesNegativeTest-695646803-project Aug 28 10:15:44.359131 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: Aug 28 10:15:44.359131 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Volume tempest-invalid-1257962568 could not be found. Aug 28 10:15:44.359131 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': 'tempest-invalid-1257962568'} Aug 28 10:15:44.359131 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:15:44.360056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:15:44.360056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 28 10:15:44.360056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 28 10:15:44.360056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 28 10:15:44.360056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 28 10:15:44.360056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 28 10:15:44.360056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 28 10:15:44.360056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 28 10:15:44.360056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 28 10:15:44.360056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 28 10:15:44.360056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 28 10:15:44.360056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 28 10:15:44.360056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 28 10:15:44.360056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 28 10:15:44.360056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 28 10:15:44.360056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1257962568 could not be found. (HTTP 404) (Request-ID: req-b73b27f5-22ae-4a83-9bbe-36deeedff428) Aug 28 10:15:44.360056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:15:44.360056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:15:44.360056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:15:44.361452 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:15:44.361452 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 28 10:15:44.361452 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 28 10:15:44.361452 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 28 10:15:44.361452 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 28 10:15:44.361452 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 28 10:15:44.361452 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 28 10:15:44.361452 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 28 10:15:44.361452 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 28 10:15:44.361452 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 28 10:15:44.361452 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 28 10:15:44.361452 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 28 10:15:44.361452 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 28 10:15:44.361452 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 28 10:15:44.361452 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 28 10:15:44.361452 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 28 10:15:44.361452 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 28 10:15:44.361452 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 28 10:15:44.361452 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 28 10:15:44.362727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 28 10:15:44.362727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 28 10:15:44.362727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 28 10:15:44.362727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 28 10:15:44.362727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1257962568 could not be found. Aug 28 10:15:44.362727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:15:44.362727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:15:44.362727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:15:44.362727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:15:44.362727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:15:44.362727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:15:44.362727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:15:44.362727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:15:44.362727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 28 10:15:44.362727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 28 10:15:44.362727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:15:44.362727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:15:44.362727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 28 10:15:44.362727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:15:44.362727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1257962568 could not be found. Aug 28 10:15:44.364052 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:15:44.364052 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:15:44.364052 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:15:44.364052 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:15:44.364052 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:15:44.364052 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:15:44.364052 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:15:44.364052 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:15:44.364052 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1257962568 could not be found. Aug 28 10:15:44.364052 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:15:44.365719 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-3995cb47-2a5a-47d8-b7b1-f337c6515d63 tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] Returning 404 to user: Volume tempest-invalid-1257962568 could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:15:44.366883 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-3995cb47-2a5a-47d8-b7b1-f337c6515d63 tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1257962568" status: 404 len: 99 microversion: 2.1 time: 1.309231 Aug 28 10:15:44.368766 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1218 bytes} [Sun Aug 28 10:15:43 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1257962568 => generated 99 bytes in 1312 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 28 10:15:44.377271 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-31f35220-21bb-47d2-a6bf-a6704c492f5f tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003849 Aug 28 10:15:44.378624 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 3/5] 10.222.0.40 () {58 vars in 1140 bytes} [Sun Aug 28 10:15:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 28 10:15:44.403715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-0cbea212-2de1-43af-880b-b2baaa9ac48a tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.019145 Aug 28 10:15:44.405666 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 3/6] 10.222.0.40 () {58 vars in 1137 bytes} [Sun Aug 28 10:15:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 28 10:15:44.420800 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2870d328-4321-40d5-9468-56d3cda1568a tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] Calling method '.version_select at 0x7f7a1d126e50>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:15:44.806906 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-2870d328-4321-40d5-9468-56d3cda1568a tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] HTTP exception thrown: Volume f3ae1333-abc7-4f86-b1aa-f093a6292b8f could not be found. Aug 28 10:15:44.810949 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2870d328-4321-40d5-9468-56d3cda1568a tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] Request method failure captured: Aug 28 10:15:44.810949 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: DELETE /compute/v2.1/os-volumes/f3ae1333-abc7-4f86-b1aa-f093a6292b8f HTTP/1.1 Aug 28 10:15:44.810949 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:15:44.810949 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:15:44.810949 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:15:44.810949 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:15:44.810949 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:15:44.810949 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:15:44.810949 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:15:44.810949 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:15:44.810949 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0BMh7ciSd-cx9t3NrcdOSyY4ccW-v62fc0wGlmO0l-kRq9GH-et6JvsOirWfS1WgjmU3SITA3sNEjWqEOHxjYnEIi2ccZga5CjsKxtBY069pfCg94J3EFUFqFuuDLXhgMEYDfYT6hMeyrcAGCSv7WStnsuC7pVhMxWPThWJPPP3IwE Aug 28 10:15:44.810949 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:15:44.810949 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:15:44.810949 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:15:44.810949 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:15:44.810949 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:15:44.810949 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:15:44.810949 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 7d83a21ea63d41909cb369f94cf3a3cc Aug 28 10:15:44.810949 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesNegativeTest-695646803 Aug 28 10:15:44.810949 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:15:44.810949 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:15:44.812764 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7d83a21ea63d41909cb369f94cf3a3cc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7d83a21ea63d41909cb369f94cf3a3cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7d83a21ea63d41909cb369f94cf3a3cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7d83a21ea63d41909cb369f94cf3a3cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:15:44.812764 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesNegativeTest-695646803 Aug 28 10:15:44.812764 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 7d83a21ea63d41909cb369f94cf3a3cc Aug 28 10:15:44.812764 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesNegativeTest-695646803 Aug 28 10:15:44.812764 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesNegativeTest-695646803-project Aug 28 10:15:44.812764 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:15:44.812764 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:15:44.812764 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: af1daf846ccd46f1819ba0010875c33b Aug 28 10:15:44.812764 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesNegativeTest-695646803-project Aug 28 10:15:44.812764 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: Aug 28 10:15:44.812764 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Volume f3ae1333-abc7-4f86-b1aa-f093a6292b8f could not be found. Aug 28 10:15:44.812764 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'id': 'f3ae1333-abc7-4f86-b1aa-f093a6292b8f'} Aug 28 10:15:44.812764 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:15:44.813793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:15:44.813793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 28 10:15:44.813793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 28 10:15:44.813793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 28 10:15:44.813793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 28 10:15:44.813793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 28 10:15:44.813793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 28 10:15:44.813793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 28 10:15:44.813793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 28 10:15:44.813793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 28 10:15:44.813793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 28 10:15:44.813793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 28 10:15:44.813793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 28 10:15:44.813793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 28 10:15:44.813793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 28 10:15:44.813793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f3ae1333-abc7-4f86-b1aa-f093a6292b8f could not be found. (HTTP 404) (Request-ID: req-45a3ee27-76b3-4079-be74-168bee6a0229) Aug 28 10:15:44.813793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:15:44.813793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:15:44.813793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:15:44.815628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:15:44.815628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 28 10:15:44.815628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 28 10:15:44.815628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 28 10:15:44.815628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 28 10:15:44.815628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 28 10:15:44.815628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 28 10:15:44.815628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 28 10:15:44.815628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 28 10:15:44.815628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 28 10:15:44.815628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 28 10:15:44.815628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 28 10:15:44.815628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 28 10:15:44.815628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 28 10:15:44.815628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 28 10:15:44.815628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 28 10:15:44.815628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 28 10:15:44.815628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 28 10:15:44.815628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 28 10:15:44.817802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 28 10:15:44.817802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 28 10:15:44.817802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 28 10:15:44.817802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 28 10:15:44.817802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f3ae1333-abc7-4f86-b1aa-f093a6292b8f could not be found. Aug 28 10:15:44.817802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:15:44.817802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:15:44.817802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:15:44.817802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:15:44.817802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:15:44.817802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:15:44.817802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:15:44.817802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:15:44.817802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 28 10:15:44.817802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 28 10:15:44.817802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:15:44.817802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:15:44.817802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 28 10:15:44.817802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:15:44.820251 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f3ae1333-abc7-4f86-b1aa-f093a6292b8f could not be found. Aug 28 10:15:44.820251 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:15:44.820251 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:15:44.820251 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:15:44.820251 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:15:44.820251 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:15:44.820251 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:15:44.820251 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:15:44.820251 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:15:44.820251 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f3ae1333-abc7-4f86-b1aa-f093a6292b8f could not be found. Aug 28 10:15:44.820251 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:15:44.822885 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2870d328-4321-40d5-9468-56d3cda1568a tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] Returning 404 to user: Volume f3ae1333-abc7-4f86-b1aa-f093a6292b8f could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:15:44.826079 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2870d328-4321-40d5-9468-56d3cda1568a tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/f3ae1333-abc7-4f86-b1aa-f093a6292b8f" status: 404 len: 109 microversion: 2.1 time: 0.412133 Aug 28 10:15:44.827888 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1248 bytes} [Sun Aug 28 10:15:44 2022] DELETE /compute/v2.1/os-volumes/f3ae1333-abc7-4f86-b1aa-f093a6292b8f => generated 109 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:15:44.839523 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-aa19685a-b29e-44f8-a9c9-e9fafaa0feff tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] Calling method '.version_select at 0x7f7a1d04d3a0>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:15:45.139269 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-aa19685a-b29e-44f8-a9c9-e9fafaa0feff tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] HTTP exception thrown: Volume 94b56cea-742d-4928-8788-59a0a719c390 could not be found. Aug 28 10:15:45.141649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-aa19685a-b29e-44f8-a9c9-e9fafaa0feff tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] Request method failure captured: Aug 28 10:15:45.141649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: GET /compute/v2.1/os-volumes/94b56cea-742d-4928-8788-59a0a719c390 HTTP/1.1 Aug 28 10:15:45.141649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:15:45.141649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:15:45.141649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:15:45.141649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:15:45.141649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:15:45.141649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:15:45.141649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:15:45.141649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:15:45.141649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0BMh7ciSd-cx9t3NrcdOSyY4ccW-v62fc0wGlmO0l-kRq9GH-et6JvsOirWfS1WgjmU3SITA3sNEjWqEOHxjYnEIi2ccZga5CjsKxtBY069pfCg94J3EFUFqFuuDLXhgMEYDfYT6hMeyrcAGCSv7WStnsuC7pVhMxWPThWJPPP3IwE Aug 28 10:15:45.141649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:15:45.141649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:15:45.141649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:15:45.141649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:15:45.141649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:15:45.141649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:15:45.141649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: 7d83a21ea63d41909cb369f94cf3a3cc Aug 28 10:15:45.141649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-VolumesNegativeTest-695646803 Aug 28 10:15:45.141649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:15:45.141649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:15:45.142936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7d83a21ea63d41909cb369f94cf3a3cc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7d83a21ea63d41909cb369f94cf3a3cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7d83a21ea63d41909cb369f94cf3a3cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7d83a21ea63d41909cb369f94cf3a3cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:15:45.142936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-VolumesNegativeTest-695646803 Aug 28 10:15:45.142936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: 7d83a21ea63d41909cb369f94cf3a3cc Aug 28 10:15:45.142936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-VolumesNegativeTest-695646803 Aug 28 10:15:45.142936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-VolumesNegativeTest-695646803-project Aug 28 10:15:45.142936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:15:45.142936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:15:45.142936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: af1daf846ccd46f1819ba0010875c33b Aug 28 10:15:45.142936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-VolumesNegativeTest-695646803-project Aug 28 10:15:45.142936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: Aug 28 10:15:45.142936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Volume 94b56cea-742d-4928-8788-59a0a719c390 could not be found. Aug 28 10:15:45.142936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': '94b56cea-742d-4928-8788-59a0a719c390'} Aug 28 10:15:45.142936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:15:45.143713 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:15:45.143713 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 28 10:15:45.143713 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 28 10:15:45.143713 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 28 10:15:45.143713 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 28 10:15:45.143713 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 28 10:15:45.143713 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 28 10:15:45.143713 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 28 10:15:45.143713 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 28 10:15:45.143713 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 28 10:15:45.143713 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 28 10:15:45.143713 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 28 10:15:45.143713 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 28 10:15:45.143713 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 28 10:15:45.143713 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 28 10:15:45.143713 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 94b56cea-742d-4928-8788-59a0a719c390 could not be found. (HTTP 404) (Request-ID: req-30845197-8a41-4a89-897a-0a670ea66100) Aug 28 10:15:45.143713 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:15:45.143713 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:15:45.143713 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:15:45.145328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:15:45.145328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 28 10:15:45.145328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 28 10:15:45.145328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 28 10:15:45.145328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 28 10:15:45.145328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 28 10:15:45.145328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 28 10:15:45.145328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 28 10:15:45.145328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 28 10:15:45.145328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 28 10:15:45.145328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 28 10:15:45.145328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 28 10:15:45.145328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 28 10:15:45.145328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 28 10:15:45.145328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 28 10:15:45.145328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 28 10:15:45.145328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 28 10:15:45.145328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 28 10:15:45.145328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 28 10:15:45.146462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 28 10:15:45.146462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 28 10:15:45.146462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 28 10:15:45.146462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 28 10:15:45.146462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 94b56cea-742d-4928-8788-59a0a719c390 could not be found. Aug 28 10:15:45.146462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:15:45.146462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:15:45.146462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:15:45.146462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:15:45.146462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:15:45.146462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:15:45.146462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:15:45.146462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:15:45.146462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 28 10:15:45.146462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 28 10:15:45.146462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:15:45.146462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:15:45.146462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 28 10:15:45.146462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:15:45.147505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 94b56cea-742d-4928-8788-59a0a719c390 could not be found. Aug 28 10:15:45.147505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:15:45.147505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:15:45.147505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:15:45.147505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:15:45.147505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:15:45.147505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:15:45.147505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:15:45.147505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:15:45.147505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 94b56cea-742d-4928-8788-59a0a719c390 could not be found. Aug 28 10:15:45.147505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:15:45.147505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-aa19685a-b29e-44f8-a9c9-e9fafaa0feff tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] Returning 404 to user: Volume 94b56cea-742d-4928-8788-59a0a719c390 could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:15:45.147505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-aa19685a-b29e-44f8-a9c9-e9fafaa0feff tempest-VolumesNegativeTest-695646803 tempest-VolumesNegativeTest-695646803-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/94b56cea-742d-4928-8788-59a0a719c390" status: 404 len: 109 microversion: 2.1 time: 0.308959 Aug 28 10:15:45.147505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Aug 28 10:15:44 2022] GET /compute/v2.1/os-volumes/94b56cea-742d-4928-8788-59a0a719c390 => generated 109 bytes in 310 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:15:46.295333 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9fbcc231-9cb3-4a58-b7cc-3bc408111c91 tempest-VolumesTestJSON-1972974960 tempest-VolumesTestJSON-1972974960-project] Calling method '.version_select at 0x7f7a1d05aa60>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:15:46.449760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9fbcc231-9cb3-4a58-b7cc-3bc408111c91 tempest-VolumesTestJSON-1972974960 tempest-VolumesTestJSON-1972974960-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/b183ded5-bb37-41f3-b3fb-24e3422561c4" status: 200 len: 351 microversion: 2.1 time: 0.161134 Aug 28 10:15:46.459583 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 5/9] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Aug 28 10:15:46 2022] GET /compute/v2.1/os-volumes/b183ded5-bb37-41f3-b3fb-24e3422561c4 => generated 351 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:15:51.722032 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-d979eb1e-67a0-4522-9ab9-fb0751a14fa1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Action: 'create', calling method: .version_select at 0x7f7a1d32cb80>, body: {"keypair": {"name": "tempest-keypair-810335687", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdDc3GJu+eM5EV0faBbpNESuYto4i+CVUQx7TPWmD5qRluQTknm65Mg7Ak1+4uEzqAbn7bN0Z7T9WNbJJel783cqOcu5RFg0aLPtGSxmY858aIWozeosHFL6ERoIiYjOQ=="}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:15:51.795922 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-d979eb1e-67a0-4522-9ab9-fb0751a14fa1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Getting quotas for project 4a3dd0514b8542d280fbe2f798714ea3. Resources: {'key_pairs'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:15:51.806692 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-d979eb1e-67a0-4522-9ab9-fb0751a14fa1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Getting quotas for user 5bb45c233ca243388bee05dede63415f and project 4a3dd0514b8542d280fbe2f798714ea3. Resources: {'key_pairs'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:15:51.880614 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-d979eb1e-67a0-4522-9ab9-fb0751a14fa1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.519738 Aug 28 10:15:51.882162 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 5/10] 10.222.0.40 () {62 vars in 1200 bytes} [Sun Aug 28 10:15:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 522 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 28 10:15:54.850721 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a7f873ea-60aa-4888-8363-e70e56f41b21 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Action: 'create', calling method: .version_select at 0x7f7a1cff60d0>, body: {"keypair": {"name": "tempest-keypair-1645604506", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIs775wEJyLY2qtFTrXrWbIWGPX53VykWOur+XaLkr58bytApi+ODznKoEoj2nOM1T7jdmFEuwdGIPlMHGYXy5vUisbKJoGKCD7RGtr6Wytcgetm2TtIJgyRnkoSsGg7KA=="}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:15:54.930202 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f8a83757-59bf-41c3-9614-efccc54887d2 tempest-VolumesTestJSON-1972974960 tempest-VolumesTestJSON-1972974960-project] Calling method '.version_select at 0x7f7a1cfcab80>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:15:54.963627 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-a7f873ea-60aa-4888-8363-e70e56f41b21 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Getting quotas for project eefcb341ab8d4823a95c5bce47395083. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:15:54.975150 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-a7f873ea-60aa-4888-8363-e70e56f41b21 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Getting quotas for user ed4711b7691643109007e173fee1c405 and project eefcb341ab8d4823a95c5bce47395083. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:15:55.053132 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a7f873ea-60aa-4888-8363-e70e56f41b21 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.476030 Aug 28 10:15:55.054354 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 6/11] 10.222.0.40 () {60 vars in 1159 bytes} [Sun Aug 28 10:15:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:15:55.061271 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f8a83757-59bf-41c3-9614-efccc54887d2 tempest-VolumesTestJSON-1972974960 tempest-VolumesTestJSON-1972974960-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/ae3468db-1926-48c8-b604-a74c8fd9664f" status: 200 len: 350 microversion: 2.1 time: 0.135357 Aug 28 10:15:55.062174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Aug 28 10:15:54 2022] GET /compute/v2.1/os-volumes/ae3468db-1926-48c8-b604-a74c8fd9664f => generated 350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:15:57.387181 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-de19506b-13ab-46ca-8278-5bf34e8fa019 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-344682766", "imageRef": "2780c39b-8bd3-4e73-9669-2b2e29474f3e", "flavorRef": "452", "networks": [{"uuid": "ef33aa86-206e-43df-8a4c-7bc3739e9861"}]}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:15:57.532393 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-9468a083-50d6-4237-858a-8ceced7ee054 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1425760997", "imageRef": "2780c39b-8bd3-4e73-9669-2b2e29474f3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb2fa6e3-46ae-494d-a7b4-37d991375272"}], "security_groups": [{"name": "tempest-securitygroup--1607917938"}], "key_name": "tempest-keypair-810335687", "user_data": "}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:15:57.597382 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-de19506b-13ab-46ca-8278-5bf34e8fa019 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] validate_networks() for [('ef33aa86-206e-43df-8a4c-7bc3739e9861', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 28 10:15:58.025595 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.network.neutron [None req-9468a083-50d6-4237-858a-8ceced7ee054 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] validate_networks() for [('bb2fa6e3-46ae-494d-a7b4-37d991375272', None, None, None, None, None)] {{(pid=120664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 28 10:15:59.125963 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-de19506b-13ab-46ca-8278-5bf34e8fa019 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 28 10:15:59.126458 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-de19506b-13ab-46ca-8278-5bf34e8fa019 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 28 10:15:59.126826 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-de19506b-13ab-46ca-8278-5bf34e8fa019 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 28 10:15:59.127215 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-de19506b-13ab-46ca-8278-5bf34e8fa019 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 28 10:15:59.127609 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-de19506b-13ab-46ca-8278-5bf34e8fa019 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 28 10:15:59.139487 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-de19506b-13ab-46ca-8278-5bf34e8fa019 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:15:59.140255 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-de19506b-13ab-46ca-8278-5bf34e8fa019 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:15:59.141093 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-de19506b-13ab-46ca-8278-5bf34e8fa019 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:15:59.142030 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-de19506b-13ab-46ca-8278-5bf34e8fa019 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:15:59.142820 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-de19506b-13ab-46ca-8278-5bf34e8fa019 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:15:59.143537 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-de19506b-13ab-46ca-8278-5bf34e8fa019 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:15:59.167241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-9468a083-50d6-4237-858a-8ceced7ee054 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Flavor limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 28 10:15:59.168498 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-9468a083-50d6-4237-858a-8ceced7ee054 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Image limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 28 10:15:59.169005 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-9468a083-50d6-4237-858a-8ceced7ee054 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Flavor pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 28 10:15:59.169565 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-9468a083-50d6-4237-858a-8ceced7ee054 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Image pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 28 10:15:59.170127 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-9468a083-50d6-4237-858a-8ceced7ee054 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 28 10:15:59.170455 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-de19506b-13ab-46ca-8278-5bf34e8fa019 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Getting quotas for project f186d5bdc9b84b4aaae07b15f7cf132f. Resources: {'instances', 'cores', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:15:59.176060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-de19506b-13ab-46ca-8278-5bf34e8fa019 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Getting quotas for user d39e2acbd72a42758f63535bac526248 and project f186d5bdc9b84b4aaae07b15f7cf132f. Resources: {'instances', 'cores', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:15:59.181050 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9468a083-50d6-4237-858a-8ceced7ee054 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:15:59.181922 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9468a083-50d6-4237-858a-8ceced7ee054 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:15:59.182350 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9468a083-50d6-4237-858a-8ceced7ee054 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:15:59.183065 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9468a083-50d6-4237-858a-8ceced7ee054 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:15:59.183506 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9468a083-50d6-4237-858a-8ceced7ee054 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:15:59.183988 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9468a083-50d6-4237-858a-8ceced7ee054 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:15:59.191562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-de19506b-13ab-46ca-8278-5bf34e8fa019 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 28 10:15:59.195767 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-de19506b-13ab-46ca-8278-5bf34e8fa019 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2780c39b-8bd3-4e73-9669-2b2e29474f3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 28 10:15:59.208411 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-9468a083-50d6-4237-858a-8ceced7ee054 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Getting quotas for project 4a3dd0514b8542d280fbe2f798714ea3. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:15:59.243811 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-9468a083-50d6-4237-858a-8ceced7ee054 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Getting quotas for user 5bb45c233ca243388bee05dede63415f and project 4a3dd0514b8542d280fbe2f798714ea3. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:15:59.271630 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-9468a083-50d6-4237-858a-8ceced7ee054 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Going to run 1 instances... {{(pid=120664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 28 10:15:59.275448 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-9468a083-50d6-4237-858a-8ceced7ee054 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2780c39b-8bd3-4e73-9669-2b2e29474f3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 28 10:15:59.286108 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-de19506b-13ab-46ca-8278-5bf34e8fa019 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.020643 Aug 28 10:15:59.300030 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 7/13] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Aug 28 10:15:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 28 10:15:59.399404 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-9468a083-50d6-4237-858a-8ceced7ee054 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.872759 Aug 28 10:15:59.400263 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 7/14] 10.222.0.40 () {62 vars in 1188 bytes} [Sun Aug 28 10:15:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 1874 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 28 10:15:59.405950 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-685e526a-868d-4a00-b0d3-724fd8499ed4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-95725943", "imageRef": "2780c39b-8bd3-4e73-9669-2b2e29474f3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:15:59.411142 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-b484f50c-d6de-485c-9007-7e1399dc57ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1550881237", "imageRef": "2780c39b-8bd3-4e73-9669-2b2e29474f3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68250cdd-7701-4086-beb4-5863d8d92f6a"}], "security_groups": [{"name": "tempest-securitygroup--913617635"}], "key_name": "tempest-keypair-1645604506", "user_data": "}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:15:59.512322 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-685e526a-868d-4a00-b0d3-724fd8499ed4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] validate_networks() for [('93556dbd-33c6-4140-9730-09404394c1cf', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 28 10:15:59.679011 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.network.neutron [None req-b484f50c-d6de-485c-9007-7e1399dc57ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] validate_networks() for [('68250cdd-7701-4086-beb4-5863d8d92f6a', None, None, None, None, None)] {{(pid=120664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 28 10:16:00.265896 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-685e526a-868d-4a00-b0d3-724fd8499ed4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 28 10:16:00.266745 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-685e526a-868d-4a00-b0d3-724fd8499ed4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 28 10:16:00.267835 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-685e526a-868d-4a00-b0d3-724fd8499ed4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 28 10:16:00.268301 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-685e526a-868d-4a00-b0d3-724fd8499ed4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 28 10:16:00.269087 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-685e526a-868d-4a00-b0d3-724fd8499ed4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 28 10:16:00.286659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-685e526a-868d-4a00-b0d3-724fd8499ed4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:00.287409 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-685e526a-868d-4a00-b0d3-724fd8499ed4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:00.288579 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-685e526a-868d-4a00-b0d3-724fd8499ed4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:00.289955 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-685e526a-868d-4a00-b0d3-724fd8499ed4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:00.291117 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-685e526a-868d-4a00-b0d3-724fd8499ed4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:00.291845 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-685e526a-868d-4a00-b0d3-724fd8499ed4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:00.318182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-685e526a-868d-4a00-b0d3-724fd8499ed4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Getting quotas for project 76d489fb3d144cc3abf03a842e70636d. Resources: {'instances', 'cores', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:16:00.333809 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-685e526a-868d-4a00-b0d3-724fd8499ed4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Getting quotas for user edbf26fde0254259a540f31139fc1a51 and project 76d489fb3d144cc3abf03a842e70636d. Resources: {'instances', 'cores', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:16:00.366909 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-685e526a-868d-4a00-b0d3-724fd8499ed4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 28 10:16:00.372958 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-685e526a-868d-4a00-b0d3-724fd8499ed4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2780c39b-8bd3-4e73-9669-2b2e29474f3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 28 10:16:00.487509 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-685e526a-868d-4a00-b0d3-724fd8499ed4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.185185 Aug 28 10:16:00.490127 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 8/15] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Aug 28 10:15:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 28 10:16:00.503648 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0737a77a-0585-4b4a-afda-2b6a8c08b91e tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:00.504362 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0737a77a-0585-4b4a-afda-2b6a8c08b91e tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:00.727438 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0737a77a-0585-4b4a-afda-2b6a8c08b91e tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:00.736003 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-b484f50c-d6de-485c-9007-7e1399dc57ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Flavor limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 28 10:16:00.736533 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-b484f50c-d6de-485c-9007-7e1399dc57ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Image limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 28 10:16:00.737155 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-b484f50c-d6de-485c-9007-7e1399dc57ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Flavor pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 28 10:16:00.737648 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-b484f50c-d6de-485c-9007-7e1399dc57ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Image pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 28 10:16:00.738327 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-b484f50c-d6de-485c-9007-7e1399dc57ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 28 10:16:00.751355 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0737a77a-0585-4b4a-afda-2b6a8c08b91e tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1214 microversion: 2.1 time: 0.262072 Aug 28 10:16:00.758861 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 9/16] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:00 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1214 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:00.758985 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b484f50c-d6de-485c-9007-7e1399dc57ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:00.759383 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b484f50c-d6de-485c-9007-7e1399dc57ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:00.760029 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b484f50c-d6de-485c-9007-7e1399dc57ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:00.760928 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b484f50c-d6de-485c-9007-7e1399dc57ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:00.761374 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b484f50c-d6de-485c-9007-7e1399dc57ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:00.761793 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b484f50c-d6de-485c-9007-7e1399dc57ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:00.772589 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3bcab8d7-fef7-49bb-bc01-a952b250f20a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:00.773285 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3bcab8d7-fef7-49bb-bc01-a952b250f20a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:00.780490 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3bcab8d7-fef7-49bb-bc01-a952b250f20a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:00.781235 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3bcab8d7-fef7-49bb-bc01-a952b250f20a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:00.781877 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3bcab8d7-fef7-49bb-bc01-a952b250f20a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:00.782765 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3bcab8d7-fef7-49bb-bc01-a952b250f20a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:00.783378 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3bcab8d7-fef7-49bb-bc01-a952b250f20a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:00.784014 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3bcab8d7-fef7-49bb-bc01-a952b250f20a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:00.802373 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-b484f50c-d6de-485c-9007-7e1399dc57ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Getting quotas for project eefcb341ab8d4823a95c5bce47395083. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:16:00.806529 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-b484f50c-d6de-485c-9007-7e1399dc57ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Getting quotas for user ed4711b7691643109007e173fee1c405 and project eefcb341ab8d4823a95c5bce47395083. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:16:00.827754 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-b484f50c-d6de-485c-9007-7e1399dc57ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Going to run 1 instances... {{(pid=120664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 28 10:16:00.830116 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-b484f50c-d6de-485c-9007-7e1399dc57ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2780c39b-8bd3-4e73-9669-2b2e29474f3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 28 10:16:00.923388 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-b484f50c-d6de-485c-9007-7e1399dc57ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.521735 Aug 28 10:16:00.925364 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 8/17] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Aug 28 10:15:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 1525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 28 10:16:00.930840 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e253bbb9-2896-4c7b-a1f7-9620cf9756c0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:00.931726 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e253bbb9-2896-4c7b-a1f7-9620cf9756c0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:01.025593 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3bcab8d7-fef7-49bb-bc01-a952b250f20a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:01.050312 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-e253bbb9-2896-4c7b-a1f7-9620cf9756c0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:01.053709 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3bcab8d7-fef7-49bb-bc01-a952b250f20a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:01.060673 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3bcab8d7-fef7-49bb-bc01-a952b250f20a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:01.062602 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3bcab8d7-fef7-49bb-bc01-a952b250f20a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1285 microversion: 2.20 time: 0.302213 Aug 28 10:16:01.076639 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-e253bbb9-2896-4c7b-a1f7-9620cf9756c0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed" status: 200 len: 1220 microversion: 2.1 time: 0.149735 Aug 28 10:16:01.077791 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 10/18] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:00 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1285 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:01.085025 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 9/19] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:00 2022] GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed => generated 1220 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:01.088043 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6c85a442-ef53-4e5a-bee3-d911085d62ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:01.089264 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6c85a442-ef53-4e5a-bee3-d911085d62ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:01.155280 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e60119fe-4036-4538-a6fb-889f3dd9ca81 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1521571810", "imageRef": "2780c39b-8bd3-4e73-9669-2b2e29474f3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:16:01.239578 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6c85a442-ef53-4e5a-bee3-d911085d62ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:01.260735 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6c85a442-ef53-4e5a-bee3-d911085d62ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1242 microversion: 2.1 time: 0.181603 Aug 28 10:16:01.261927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 11/20] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:01 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1242 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:01.297698 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.network.neutron [None req-e60119fe-4036-4538-a6fb-889f3dd9ca81 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] validate_networks() for [('93556dbd-33c6-4140-9730-09404394c1cf', None, None, None, None, None)] {{(pid=120664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 28 10:16:01.775396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-e60119fe-4036-4538-a6fb-889f3dd9ca81 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Flavor limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 28 10:16:01.775907 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-e60119fe-4036-4538-a6fb-889f3dd9ca81 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Image limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 28 10:16:01.781312 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-23710fa0-0b6c-45b4-a86c-ec81f006c2a9 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:01.781957 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-23710fa0-0b6c-45b4-a86c-ec81f006c2a9 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:01.785825 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-e60119fe-4036-4538-a6fb-889f3dd9ca81 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Flavor pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 28 10:16:01.786609 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-e60119fe-4036-4538-a6fb-889f3dd9ca81 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Image pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 28 10:16:01.787215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-e60119fe-4036-4538-a6fb-889f3dd9ca81 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 28 10:16:01.793735 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23710fa0-0b6c-45b4-a86c-ec81f006c2a9 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:01.794423 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23710fa0-0b6c-45b4-a86c-ec81f006c2a9 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:01.794925 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23710fa0-0b6c-45b4-a86c-ec81f006c2a9 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:01.795631 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23710fa0-0b6c-45b4-a86c-ec81f006c2a9 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:01.796083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23710fa0-0b6c-45b4-a86c-ec81f006c2a9 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:01.796664 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23710fa0-0b6c-45b4-a86c-ec81f006c2a9 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:01.797526 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e60119fe-4036-4538-a6fb-889f3dd9ca81 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:01.798107 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e60119fe-4036-4538-a6fb-889f3dd9ca81 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:01.798775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e60119fe-4036-4538-a6fb-889f3dd9ca81 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:01.799672 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e60119fe-4036-4538-a6fb-889f3dd9ca81 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:01.800214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e60119fe-4036-4538-a6fb-889f3dd9ca81 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:01.800724 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e60119fe-4036-4538-a6fb-889f3dd9ca81 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:01.820177 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-e60119fe-4036-4538-a6fb-889f3dd9ca81 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Getting quotas for project 76d489fb3d144cc3abf03a842e70636d. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:16:01.824643 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-e60119fe-4036-4538-a6fb-889f3dd9ca81 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Getting quotas for user edbf26fde0254259a540f31139fc1a51 and project 76d489fb3d144cc3abf03a842e70636d. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:16:01.837407 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e60119fe-4036-4538-a6fb-889f3dd9ca81 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Going to run 1 instances... {{(pid=120664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 28 10:16:01.848423 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e60119fe-4036-4538-a6fb-889f3dd9ca81 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2780c39b-8bd3-4e73-9669-2b2e29474f3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 28 10:16:01.873526 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-23710fa0-0b6c-45b4-a86c-ec81f006c2a9 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:01.882785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-23710fa0-0b6c-45b4-a86c-ec81f006c2a9 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1218 microversion: 2.1 time: 0.105165 Aug 28 10:16:01.897345 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 12/21] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:01 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:01.915127 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-e60119fe-4036-4538-a6fb-889f3dd9ca81 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.764555 Aug 28 10:16:01.916022 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 10/22] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Aug 28 10:16:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 28 10:16:01.929002 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-81f871f3-2520-44b1-9832-edcde22a5bf2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:01.929990 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-81f871f3-2520-44b1-9832-edcde22a5bf2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:02.003587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-81f871f3-2520-44b1-9832-edcde22a5bf2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:02.015107 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-81f871f3-2520-44b1-9832-edcde22a5bf2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1222 microversion: 2.1 time: 0.089815 Aug 28 10:16:02.016860 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 13/23] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:01 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:02.088901 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-b97a8d15-93a2-4033-80d0-c9f2e950c5c5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:02.089537 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-b97a8d15-93a2-4033-80d0-c9f2e950c5c5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:02.097286 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b97a8d15-93a2-4033-80d0-c9f2e950c5c5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:02.097771 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b97a8d15-93a2-4033-80d0-c9f2e950c5c5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:02.098382 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b97a8d15-93a2-4033-80d0-c9f2e950c5c5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:02.099267 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b97a8d15-93a2-4033-80d0-c9f2e950c5c5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:02.099878 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b97a8d15-93a2-4033-80d0-c9f2e950c5c5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:02.100276 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b97a8d15-93a2-4033-80d0-c9f2e950c5c5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:02.248850 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-b97a8d15-93a2-4033-80d0-c9f2e950c5c5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:02.263181 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-b97a8d15-93a2-4033-80d0-c9f2e950c5c5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:02.264901 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-b97a8d15-93a2-4033-80d0-c9f2e950c5c5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:02.266201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-b97a8d15-93a2-4033-80d0-c9f2e950c5c5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1285 microversion: 2.20 time: 0.181296 Aug 28 10:16:02.266764 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 11/24] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:02 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:02.286894 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1b3e6408-d1b2-4d33-a280-43f8aaf70822 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:02.287604 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1b3e6408-d1b2-4d33-a280-43f8aaf70822 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:02.294891 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1b3e6408-d1b2-4d33-a280-43f8aaf70822 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:02.295478 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1b3e6408-d1b2-4d33-a280-43f8aaf70822 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:02.296075 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1b3e6408-d1b2-4d33-a280-43f8aaf70822 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:02.297153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1b3e6408-d1b2-4d33-a280-43f8aaf70822 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:02.297728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1b3e6408-d1b2-4d33-a280-43f8aaf70822 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:02.299036 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1b3e6408-d1b2-4d33-a280-43f8aaf70822 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:02.371994 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1b3e6408-d1b2-4d33-a280-43f8aaf70822 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:02.384361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1b3e6408-d1b2-4d33-a280-43f8aaf70822 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1246 microversion: 2.1 time: 0.101228 Aug 28 10:16:02.385713 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 14/25] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:02 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1246 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:02.906323 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-fff219ad-dedc-4d94-9fea-1298b8956407 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:02.907038 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-fff219ad-dedc-4d94-9fea-1298b8956407 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:02.914887 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fff219ad-dedc-4d94-9fea-1298b8956407 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:02.915373 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fff219ad-dedc-4d94-9fea-1298b8956407 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:02.915802 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fff219ad-dedc-4d94-9fea-1298b8956407 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:02.916485 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fff219ad-dedc-4d94-9fea-1298b8956407 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:02.916974 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fff219ad-dedc-4d94-9fea-1298b8956407 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:02.917397 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fff219ad-dedc-4d94-9fea-1298b8956407 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:02.976767 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-fff219ad-dedc-4d94-9fea-1298b8956407 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:02.984494 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-fff219ad-dedc-4d94-9fea-1298b8956407 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1218 microversion: 2.1 time: 0.082654 Aug 28 10:16:02.985092 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 12/26] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:02 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:03.036997 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bcfa6815-317f-4a08-aa50-d810dbc7f25c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:03.037534 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bcfa6815-317f-4a08-aa50-d810dbc7f25c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:03.044020 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bcfa6815-317f-4a08-aa50-d810dbc7f25c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:03.044346 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bcfa6815-317f-4a08-aa50-d810dbc7f25c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:03.044805 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bcfa6815-317f-4a08-aa50-d810dbc7f25c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:03.045522 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bcfa6815-317f-4a08-aa50-d810dbc7f25c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:03.045989 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bcfa6815-317f-4a08-aa50-d810dbc7f25c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:03.046402 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bcfa6815-317f-4a08-aa50-d810dbc7f25c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:03.107085 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bcfa6815-317f-4a08-aa50-d810dbc7f25c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:03.115785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bcfa6815-317f-4a08-aa50-d810dbc7f25c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1226 microversion: 2.1 time: 0.082933 Aug 28 10:16:03.116636 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 15/27] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:03 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:03.290331 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-d75f7435-ba7d-4a7e-b68d-0b761d87831c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:03.290905 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-d75f7435-ba7d-4a7e-b68d-0b761d87831c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:03.297792 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d75f7435-ba7d-4a7e-b68d-0b761d87831c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:03.298245 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d75f7435-ba7d-4a7e-b68d-0b761d87831c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:03.298695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d75f7435-ba7d-4a7e-b68d-0b761d87831c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:03.299379 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d75f7435-ba7d-4a7e-b68d-0b761d87831c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:03.299820 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d75f7435-ba7d-4a7e-b68d-0b761d87831c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:03.300234 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d75f7435-ba7d-4a7e-b68d-0b761d87831c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:03.369080 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d75f7435-ba7d-4a7e-b68d-0b761d87831c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:03.377171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d75f7435-ba7d-4a7e-b68d-0b761d87831c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:03.378608 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d75f7435-ba7d-4a7e-b68d-0b761d87831c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:03.379699 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-d75f7435-ba7d-4a7e-b68d-0b761d87831c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1285 microversion: 2.20 time: 0.094162 Aug 28 10:16:03.380326 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 13/28] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:03 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:03.405754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a4dfadea-92a2-4d7e-b0b7-2613e21289f2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:03.406359 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a4dfadea-92a2-4d7e-b0b7-2613e21289f2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:03.412533 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4dfadea-92a2-4d7e-b0b7-2613e21289f2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:03.413031 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4dfadea-92a2-4d7e-b0b7-2613e21289f2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:03.413457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4dfadea-92a2-4d7e-b0b7-2613e21289f2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:03.414482 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4dfadea-92a2-4d7e-b0b7-2613e21289f2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:03.414929 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4dfadea-92a2-4d7e-b0b7-2613e21289f2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:03.415340 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4dfadea-92a2-4d7e-b0b7-2613e21289f2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:03.486581 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a4dfadea-92a2-4d7e-b0b7-2613e21289f2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:03.494756 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a4dfadea-92a2-4d7e-b0b7-2613e21289f2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1246 microversion: 2.1 time: 0.092872 Aug 28 10:16:03.495323 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 16/29] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:03 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:04.009190 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e3424b0c-17fd-4938-93e1-917614cc8aa6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:04.009939 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e3424b0c-17fd-4938-93e1-917614cc8aa6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:04.017610 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e3424b0c-17fd-4938-93e1-917614cc8aa6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:04.018273 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e3424b0c-17fd-4938-93e1-917614cc8aa6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:04.018808 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e3424b0c-17fd-4938-93e1-917614cc8aa6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:04.019654 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e3424b0c-17fd-4938-93e1-917614cc8aa6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:04.020109 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e3424b0c-17fd-4938-93e1-917614cc8aa6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:04.020573 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e3424b0c-17fd-4938-93e1-917614cc8aa6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:04.097301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-e3424b0c-17fd-4938-93e1-917614cc8aa6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:04.109642 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-e3424b0c-17fd-4938-93e1-917614cc8aa6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1266 microversion: 2.1 time: 0.106053 Aug 28 10:16:04.111170 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 14/30] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:04 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:04.139214 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-663a148a-f0ba-4ee9-8f2f-6b8e06c89c85 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:04.140086 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-663a148a-f0ba-4ee9-8f2f-6b8e06c89c85 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:04.147879 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-663a148a-f0ba-4ee9-8f2f-6b8e06c89c85 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:04.148452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-663a148a-f0ba-4ee9-8f2f-6b8e06c89c85 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:04.149454 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-663a148a-f0ba-4ee9-8f2f-6b8e06c89c85 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:04.150380 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-663a148a-f0ba-4ee9-8f2f-6b8e06c89c85 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:04.151019 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-663a148a-f0ba-4ee9-8f2f-6b8e06c89c85 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:04.152121 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-663a148a-f0ba-4ee9-8f2f-6b8e06c89c85 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:04.246847 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-663a148a-f0ba-4ee9-8f2f-6b8e06c89c85 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:04.255627 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-663a148a-f0ba-4ee9-8f2f-6b8e06c89c85 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1274 microversion: 2.1 time: 0.122357 Aug 28 10:16:04.256353 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 17/31] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:04 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1274 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:04.402162 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-51174b75-e5b5-4541-9988-2f6babeef754 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:04.402818 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-51174b75-e5b5-4541-9988-2f6babeef754 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:04.408671 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-51174b75-e5b5-4541-9988-2f6babeef754 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:04.409142 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-51174b75-e5b5-4541-9988-2f6babeef754 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:04.409568 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-51174b75-e5b5-4541-9988-2f6babeef754 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:04.410236 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-51174b75-e5b5-4541-9988-2f6babeef754 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:04.410673 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-51174b75-e5b5-4541-9988-2f6babeef754 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:04.411128 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-51174b75-e5b5-4541-9988-2f6babeef754 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:04.481056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-51174b75-e5b5-4541-9988-2f6babeef754 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:04.489658 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-51174b75-e5b5-4541-9988-2f6babeef754 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:04.491115 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-51174b75-e5b5-4541-9988-2f6babeef754 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:04.492244 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-51174b75-e5b5-4541-9988-2f6babeef754 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1333 microversion: 2.20 time: 0.094177 Aug 28 10:16:04.492848 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 15/32] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:04 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1333 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:04.521382 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fecb3c6a-c3b6-490a-84c8-ae8ea352ddc2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:04.521995 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fecb3c6a-c3b6-490a-84c8-ae8ea352ddc2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:04.528548 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fecb3c6a-c3b6-490a-84c8-ae8ea352ddc2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:04.529022 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fecb3c6a-c3b6-490a-84c8-ae8ea352ddc2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:04.529453 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fecb3c6a-c3b6-490a-84c8-ae8ea352ddc2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:04.530130 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fecb3c6a-c3b6-490a-84c8-ae8ea352ddc2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:04.530574 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fecb3c6a-c3b6-490a-84c8-ae8ea352ddc2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:04.530990 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fecb3c6a-c3b6-490a-84c8-ae8ea352ddc2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:04.595712 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fecb3c6a-c3b6-490a-84c8-ae8ea352ddc2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:04.603681 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fecb3c6a-c3b6-490a-84c8-ae8ea352ddc2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1294 microversion: 2.1 time: 0.092259 Aug 28 10:16:04.604254 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 18/33] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:04 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:05.132016 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-0e215280-4679-47bb-a744-68a377420d9f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:05.133440 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-0e215280-4679-47bb-a744-68a377420d9f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:05.144866 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0e215280-4679-47bb-a744-68a377420d9f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:05.146294 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0e215280-4679-47bb-a744-68a377420d9f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:05.147453 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0e215280-4679-47bb-a744-68a377420d9f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:05.148482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0e215280-4679-47bb-a744-68a377420d9f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:05.149308 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0e215280-4679-47bb-a744-68a377420d9f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:05.149872 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0e215280-4679-47bb-a744-68a377420d9f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:05.273937 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-0e215280-4679-47bb-a744-68a377420d9f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:05.282671 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-0e215280-4679-47bb-a744-68a377420d9f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1266 microversion: 2.1 time: 0.154876 Aug 28 10:16:05.282818 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b130f234-eec6-431d-8c3f-ccee7cae6e9d tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:05.283313 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b130f234-eec6-431d-8c3f-ccee7cae6e9d tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:05.290731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 16/34] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:05 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:05.290857 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b130f234-eec6-431d-8c3f-ccee7cae6e9d tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:05.291245 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b130f234-eec6-431d-8c3f-ccee7cae6e9d tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:05.291844 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b130f234-eec6-431d-8c3f-ccee7cae6e9d tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:05.292732 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b130f234-eec6-431d-8c3f-ccee7cae6e9d tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:05.293316 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b130f234-eec6-431d-8c3f-ccee7cae6e9d tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:05.293865 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b130f234-eec6-431d-8c3f-ccee7cae6e9d tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:05.378834 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b130f234-eec6-431d-8c3f-ccee7cae6e9d tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:05.389164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b130f234-eec6-431d-8c3f-ccee7cae6e9d tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1282 microversion: 2.1 time: 0.110755 Aug 28 10:16:05.390269 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 19/35] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:05 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1282 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:05.517777 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8179d223-e78f-4a12-8764-56579c4ac643 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:05.518685 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-8179d223-e78f-4a12-8764-56579c4ac643 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:05.527109 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8179d223-e78f-4a12-8764-56579c4ac643 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:05.527593 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8179d223-e78f-4a12-8764-56579c4ac643 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:05.543427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8179d223-e78f-4a12-8764-56579c4ac643 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:05.546696 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8179d223-e78f-4a12-8764-56579c4ac643 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:05.547238 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8179d223-e78f-4a12-8764-56579c4ac643 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:05.547678 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8179d223-e78f-4a12-8764-56579c4ac643 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:05.624689 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-75b65607-bbeb-466f-8260-310c30abe898 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:05.625318 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-75b65607-bbeb-466f-8260-310c30abe898 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:05.640491 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-75b65607-bbeb-466f-8260-310c30abe898 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:05.643296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-75b65607-bbeb-466f-8260-310c30abe898 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:05.643781 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-75b65607-bbeb-466f-8260-310c30abe898 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:05.649968 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-75b65607-bbeb-466f-8260-310c30abe898 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:05.655236 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-75b65607-bbeb-466f-8260-310c30abe898 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:05.658667 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-75b65607-bbeb-466f-8260-310c30abe898 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:05.836818 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8179d223-e78f-4a12-8764-56579c4ac643 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:05.860322 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8179d223-e78f-4a12-8764-56579c4ac643 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:05.861926 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8179d223-e78f-4a12-8764-56579c4ac643 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:05.863131 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-8179d223-e78f-4a12-8764-56579c4ac643 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1333 microversion: 2.20 time: 0.352597 Aug 28 10:16:05.863842 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 17/36] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:05 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1333 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:05.868909 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-d31b42fd-f8c3-4eb5-87a1-bfe1121a705d tempest-VolumesTestJSON-1972974960 tempest-VolumesTestJSON-1972974960-project] Calling method '.version_select at 0x7f7a1c662280>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:05.870510 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-75b65607-bbeb-466f-8260-310c30abe898 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:05.884424 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-75b65607-bbeb-466f-8260-310c30abe898 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1302 microversion: 2.1 time: 0.264224 Aug 28 10:16:05.897853 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 20/37] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:05 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1302 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:16:05.969617 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-d31b42fd-f8c3-4eb5-87a1-bfe1121a705d tempest-VolumesTestJSON-1972974960 tempest-VolumesTestJSON-1972974960-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/0ab38865-a4dd-490e-bb97-4fb923554117" status: 200 len: 351 microversion: 2.1 time: 0.104212 Aug 28 10:16:05.970203 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 18/38] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Aug 28 10:16:05 2022] GET /compute/v2.1/os-volumes/0ab38865-a4dd-490e-bb97-4fb923554117 => generated 351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:16:05.985668 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7d0f04a9-b3bd-4fba-96c2-bfbb438d434d tempest-VolumesTestJSON-1972974960 tempest-VolumesTestJSON-1972974960-project] Calling method '.version_select at 0x7f7a1c666b80>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:06.092865 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7d0f04a9-b3bd-4fba-96c2-bfbb438d434d tempest-VolumesTestJSON-1972974960 tempest-VolumesTestJSON-1972974960-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.113981 Aug 28 10:16:06.094274 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 21/39] 10.222.0.40 () {58 vars in 1134 bytes} [Sun Aug 28 10:16:05 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:06.110338 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4895e11b-513f-40b0-b887-4a273db3c969 tempest-VolumesTestJSON-1972974960 tempest-VolumesTestJSON-1972974960-project] Calling method '.version_select at 0x7f7a1c5c43a0>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:06.214098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4895e11b-513f-40b0-b887-4a273db3c969 tempest-VolumesTestJSON-1972974960 tempest-VolumesTestJSON-1972974960-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.107408 Aug 28 10:16:06.224807 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 19/40] 10.222.0.40 () {58 vars in 1149 bytes} [Sun Aug 28 10:16:06 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:16:06.229372 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b8f9ed39-6694-48b5-9906-ecd3bcbe3f7a tempest-VolumesTestJSON-1972974960 tempest-VolumesTestJSON-1972974960-project] Calling method '.version_select at 0x7f7a1c571ee0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:06.305028 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-3b6dee93-6632-41d9-a3db-1c2e4df0f2b3 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:06.305633 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-3b6dee93-6632-41d9-a3db-1c2e4df0f2b3 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:06.318112 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3b6dee93-6632-41d9-a3db-1c2e4df0f2b3 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:06.318742 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3b6dee93-6632-41d9-a3db-1c2e4df0f2b3 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:06.319200 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3b6dee93-6632-41d9-a3db-1c2e4df0f2b3 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:06.320066 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3b6dee93-6632-41d9-a3db-1c2e4df0f2b3 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:06.320686 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3b6dee93-6632-41d9-a3db-1c2e4df0f2b3 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:06.321389 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3b6dee93-6632-41d9-a3db-1c2e4df0f2b3 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:06.321875 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b8f9ed39-6694-48b5-9906-ecd3bcbe3f7a tempest-VolumesTestJSON-1972974960 tempest-VolumesTestJSON-1972974960-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.096952 Aug 28 10:16:06.322461 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 22/41] 10.222.0.40 () {58 vars in 1134 bytes} [Sun Aug 28 10:16:06 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:06.335489 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3495810d-1283-4e7b-81e8-fbc08224a4f5 tempest-VolumesTestJSON-1972974960 tempest-VolumesTestJSON-1972974960-project] Calling method '.version_select at 0x7f7a1c581940>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:06.410733 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-3b6dee93-6632-41d9-a3db-1c2e4df0f2b3 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:06.428786 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-3b6dee93-6632-41d9-a3db-1c2e4df0f2b3 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1274 microversion: 2.1 time: 0.127608 Aug 28 10:16:06.443702 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 20/42] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:06 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1274 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:06.450283 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c4c62077-b2a4-4ce6-9db9-c2645da5946f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:06.452360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c4c62077-b2a4-4ce6-9db9-c2645da5946f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:06.464778 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c4c62077-b2a4-4ce6-9db9-c2645da5946f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:06.466115 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c4c62077-b2a4-4ce6-9db9-c2645da5946f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:06.467264 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c4c62077-b2a4-4ce6-9db9-c2645da5946f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:06.468302 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c4c62077-b2a4-4ce6-9db9-c2645da5946f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:06.469259 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c4c62077-b2a4-4ce6-9db9-c2645da5946f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:06.469777 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c4c62077-b2a4-4ce6-9db9-c2645da5946f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:06.486705 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3495810d-1283-4e7b-81e8-fbc08224a4f5 tempest-VolumesTestJSON-1972974960 tempest-VolumesTestJSON-1972974960-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.154984 Aug 28 10:16:06.487671 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 23/43] 10.222.0.40 () {58 vars in 1167 bytes} [Sun Aug 28 10:16:06 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:16:06.500494 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a18d24dc-36c7-4be8-8c11-8c8b2278b255 tempest-VolumesTestJSON-1972974960 tempest-VolumesTestJSON-1972974960-project] Calling method '.version_select at 0x7f7a1c666c10>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:06.576798 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c4c62077-b2a4-4ce6-9db9-c2645da5946f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:06.589085 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c4c62077-b2a4-4ce6-9db9-c2645da5946f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1280 microversion: 2.1 time: 0.143621 Aug 28 10:16:06.590699 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 21/44] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:06 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1280 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:06.613080 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a18d24dc-36c7-4be8-8c11-8c8b2278b255 tempest-VolumesTestJSON-1972974960 tempest-VolumesTestJSON-1972974960-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.115830 Aug 28 10:16:06.613681 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 24/45] 10.222.0.40 () {58 vars in 1170 bytes} [Sun Aug 28 10:16:06 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:16:06.628485 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c224d4fb-9658-4996-9dab-a25ad1d07376 tempest-VolumesTestJSON-1972974960 tempest-VolumesTestJSON-1972974960-project] Calling method '.version_select at 0x7f7a1c64ea60>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:06.734817 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c224d4fb-9658-4996-9dab-a25ad1d07376 tempest-VolumesTestJSON-1972974960 tempest-VolumesTestJSON-1972974960-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.110790 Aug 28 10:16:06.735392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 22/46] 10.222.0.40 () {58 vars in 1155 bytes} [Sun Aug 28 10:16:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:06.748281 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-44bc8f97-af8f-43c6-b705-e3d25c99efb1 tempest-VolumesTestJSON-1972974960 tempest-VolumesTestJSON-1972974960-project] Calling method '.version_select at 0x7f7a1c5715e0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:06.833015 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-44bc8f97-af8f-43c6-b705-e3d25c99efb1 tempest-VolumesTestJSON-1972974960 tempest-VolumesTestJSON-1972974960-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088350 Aug 28 10:16:06.833822 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 25/47] 10.222.0.40 () {58 vars in 1188 bytes} [Sun Aug 28 10:16:06 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:16:06.847146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c1927fa7-114c-41b2-a7fe-24496fdc8960 tempest-VolumesTestJSON-1972974960 tempest-VolumesTestJSON-1972974960-project] Calling method '.version_select at 0x7f7a1c6624c0>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:06.886059 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-195f7599-2675-43f8-a709-47922c413486 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:06.886669 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-195f7599-2675-43f8-a709-47922c413486 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:06.893039 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-195f7599-2675-43f8-a709-47922c413486 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:06.893694 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-195f7599-2675-43f8-a709-47922c413486 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:06.894255 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-195f7599-2675-43f8-a709-47922c413486 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:06.895300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-195f7599-2675-43f8-a709-47922c413486 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:06.895956 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-195f7599-2675-43f8-a709-47922c413486 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:06.896520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-195f7599-2675-43f8-a709-47922c413486 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:06.950757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c1927fa7-114c-41b2-a7fe-24496fdc8960 tempest-VolumesTestJSON-1972974960 tempest-VolumesTestJSON-1972974960-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.107584 Aug 28 10:16:06.952979 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 23/48] 10.222.0.40 () {58 vars in 1155 bytes} [Sun Aug 28 10:16:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:06.963525 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-26ef5b60-df0e-4e66-bdb7-92b0472cee74 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:06.964317 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-26ef5b60-df0e-4e66-bdb7-92b0472cee74 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:06.978861 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-26ef5b60-df0e-4e66-bdb7-92b0472cee74 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:06.982550 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-26ef5b60-df0e-4e66-bdb7-92b0472cee74 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:06.989655 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-26ef5b60-df0e-4e66-bdb7-92b0472cee74 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:06.990460 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-26ef5b60-df0e-4e66-bdb7-92b0472cee74 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:06.990930 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-26ef5b60-df0e-4e66-bdb7-92b0472cee74 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:06.991655 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-26ef5b60-df0e-4e66-bdb7-92b0472cee74 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:07.004868 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-195f7599-2675-43f8-a709-47922c413486 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:07.014858 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-195f7599-2675-43f8-a709-47922c413486 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:07.023077 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-195f7599-2675-43f8-a709-47922c413486 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:07.024625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-195f7599-2675-43f8-a709-47922c413486 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1341 microversion: 2.20 time: 0.142430 Aug 28 10:16:07.030599 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 26/49] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:06 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1341 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 28 10:16:07.087382 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-26ef5b60-df0e-4e66-bdb7-92b0472cee74 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:07.096996 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-26ef5b60-df0e-4e66-bdb7-92b0472cee74 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1312 microversion: 2.1 time: 0.142923 Aug 28 10:16:07.097811 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 24/50] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:06 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1312 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:07.451842 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-be3e0660-3d72-4490-a73f-bcac9c0898dd tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:07.452663 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-be3e0660-3d72-4490-a73f-bcac9c0898dd tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:07.458972 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-be3e0660-3d72-4490-a73f-bcac9c0898dd tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:07.459442 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-be3e0660-3d72-4490-a73f-bcac9c0898dd tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:07.459861 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-be3e0660-3d72-4490-a73f-bcac9c0898dd tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:07.460763 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-be3e0660-3d72-4490-a73f-bcac9c0898dd tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:07.461339 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-be3e0660-3d72-4490-a73f-bcac9c0898dd tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:07.461978 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-be3e0660-3d72-4490-a73f-bcac9c0898dd tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:07.529877 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-be3e0660-3d72-4490-a73f-bcac9c0898dd tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:07.537577 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-be3e0660-3d72-4490-a73f-bcac9c0898dd tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1274 microversion: 2.1 time: 0.090189 Aug 28 10:16:07.538155 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 27/51] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:07 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1274 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:07.610449 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-85afa3e1-7469-464c-817a-aa19466685d4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:07.611635 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-85afa3e1-7469-464c-817a-aa19466685d4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:07.618630 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-85afa3e1-7469-464c-817a-aa19466685d4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:07.619102 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-85afa3e1-7469-464c-817a-aa19466685d4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:07.619535 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-85afa3e1-7469-464c-817a-aa19466685d4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:07.620235 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-85afa3e1-7469-464c-817a-aa19466685d4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:07.620712 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-85afa3e1-7469-464c-817a-aa19466685d4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:07.621126 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-85afa3e1-7469-464c-817a-aa19466685d4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:07.683914 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-85afa3e1-7469-464c-817a-aa19466685d4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:07.692302 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-85afa3e1-7469-464c-817a-aa19466685d4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1280 microversion: 2.1 time: 0.085680 Aug 28 10:16:07.692955 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 25/52] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:07 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:08.053395 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a9760a57-32cc-49c6-9878-adca20a84489 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:08.054011 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a9760a57-32cc-49c6-9878-adca20a84489 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:08.060247 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a9760a57-32cc-49c6-9878-adca20a84489 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:08.060769 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a9760a57-32cc-49c6-9878-adca20a84489 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:08.061195 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a9760a57-32cc-49c6-9878-adca20a84489 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:08.061914 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a9760a57-32cc-49c6-9878-adca20a84489 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:08.062338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a9760a57-32cc-49c6-9878-adca20a84489 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:08.062748 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a9760a57-32cc-49c6-9878-adca20a84489 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:08.120291 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-90de0a2a-4b25-420a-acaa-fe8fbe92bbf0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:08.121308 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-90de0a2a-4b25-420a-acaa-fe8fbe92bbf0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:08.130706 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-90de0a2a-4b25-420a-acaa-fe8fbe92bbf0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:08.131261 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-90de0a2a-4b25-420a-acaa-fe8fbe92bbf0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:08.131759 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-90de0a2a-4b25-420a-acaa-fe8fbe92bbf0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:08.132566 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-90de0a2a-4b25-420a-acaa-fe8fbe92bbf0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:08.133054 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-90de0a2a-4b25-420a-acaa-fe8fbe92bbf0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:08.133528 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-90de0a2a-4b25-420a-acaa-fe8fbe92bbf0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:08.133998 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a9760a57-32cc-49c6-9878-adca20a84489 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:08.142665 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a9760a57-32cc-49c6-9878-adca20a84489 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:08.144332 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a9760a57-32cc-49c6-9878-adca20a84489 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:08.145626 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a9760a57-32cc-49c6-9878-adca20a84489 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1341 microversion: 2.20 time: 0.096337 Aug 28 10:16:08.146685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 28/53] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:08 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1341 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:08.199963 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-90de0a2a-4b25-420a-acaa-fe8fbe92bbf0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:08.212186 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-90de0a2a-4b25-420a-acaa-fe8fbe92bbf0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1312 microversion: 2.1 time: 0.096227 Aug 28 10:16:08.213090 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 26/54] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:08 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:08.558673 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-58f27eeb-cf77-49e9-9cee-8340f89414b2 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:08.559282 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-58f27eeb-cf77-49e9-9cee-8340f89414b2 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:08.566305 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-58f27eeb-cf77-49e9-9cee-8340f89414b2 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:08.566795 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-58f27eeb-cf77-49e9-9cee-8340f89414b2 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:08.567213 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-58f27eeb-cf77-49e9-9cee-8340f89414b2 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:08.568031 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-58f27eeb-cf77-49e9-9cee-8340f89414b2 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:08.568471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-58f27eeb-cf77-49e9-9cee-8340f89414b2 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:08.568915 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-58f27eeb-cf77-49e9-9cee-8340f89414b2 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:08.633723 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-58f27eeb-cf77-49e9-9cee-8340f89414b2 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:08.641850 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-58f27eeb-cf77-49e9-9cee-8340f89414b2 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1274 microversion: 2.1 time: 0.087102 Aug 28 10:16:08.642415 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 29/55] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:08 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:08.714331 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-74a0c207-b357-4b04-aea5-5ab7bcbc7892 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:08.715264 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-74a0c207-b357-4b04-aea5-5ab7bcbc7892 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:08.721907 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-74a0c207-b357-4b04-aea5-5ab7bcbc7892 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:08.722381 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-74a0c207-b357-4b04-aea5-5ab7bcbc7892 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:08.722807 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-74a0c207-b357-4b04-aea5-5ab7bcbc7892 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:08.723490 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-74a0c207-b357-4b04-aea5-5ab7bcbc7892 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:08.723957 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-74a0c207-b357-4b04-aea5-5ab7bcbc7892 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:08.724372 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-74a0c207-b357-4b04-aea5-5ab7bcbc7892 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:08.905572 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-74a0c207-b357-4b04-aea5-5ab7bcbc7892 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:08.914994 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-74a0c207-b357-4b04-aea5-5ab7bcbc7892 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1280 microversion: 2.1 time: 0.204965 Aug 28 10:16:08.915579 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 27/56] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:08 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1280 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:09.171347 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7abb56ba-030f-4e6a-b6df-d0d77c9ec3fa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:09.171940 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7abb56ba-030f-4e6a-b6df-d0d77c9ec3fa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:09.178035 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7abb56ba-030f-4e6a-b6df-d0d77c9ec3fa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:09.178490 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7abb56ba-030f-4e6a-b6df-d0d77c9ec3fa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:09.178913 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7abb56ba-030f-4e6a-b6df-d0d77c9ec3fa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:09.179588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7abb56ba-030f-4e6a-b6df-d0d77c9ec3fa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:09.180011 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7abb56ba-030f-4e6a-b6df-d0d77c9ec3fa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:09.180417 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7abb56ba-030f-4e6a-b6df-d0d77c9ec3fa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:09.237578 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-685780e6-74bc-4b52-8339-56378543ae17 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:09.237578 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-685780e6-74bc-4b52-8339-56378543ae17 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:09.241941 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-685780e6-74bc-4b52-8339-56378543ae17 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:09.242077 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-685780e6-74bc-4b52-8339-56378543ae17 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:09.242439 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-685780e6-74bc-4b52-8339-56378543ae17 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:09.243493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-685780e6-74bc-4b52-8339-56378543ae17 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:09.243936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-685780e6-74bc-4b52-8339-56378543ae17 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:09.244631 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-685780e6-74bc-4b52-8339-56378543ae17 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:09.267131 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7abb56ba-030f-4e6a-b6df-d0d77c9ec3fa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:09.267131 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7abb56ba-030f-4e6a-b6df-d0d77c9ec3fa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:09.267335 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7abb56ba-030f-4e6a-b6df-d0d77c9ec3fa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:09.267836 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7abb56ba-030f-4e6a-b6df-d0d77c9ec3fa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1341 microversion: 2.20 time: 0.100431 Aug 28 10:16:09.276710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 30/57] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:09 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1341 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:09.316041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-685780e6-74bc-4b52-8339-56378543ae17 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:09.325152 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-685780e6-74bc-4b52-8339-56378543ae17 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1312 microversion: 2.1 time: 0.095554 Aug 28 10:16:09.325739 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 28/58] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:09 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:09.664618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ca5deb3c-d8c3-4ad5-8af3-60ad6e55b501 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:09.665955 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ca5deb3c-d8c3-4ad5-8af3-60ad6e55b501 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:09.673768 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ca5deb3c-d8c3-4ad5-8af3-60ad6e55b501 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:09.674538 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ca5deb3c-d8c3-4ad5-8af3-60ad6e55b501 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:09.675151 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ca5deb3c-d8c3-4ad5-8af3-60ad6e55b501 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:09.676052 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ca5deb3c-d8c3-4ad5-8af3-60ad6e55b501 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:09.676823 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ca5deb3c-d8c3-4ad5-8af3-60ad6e55b501 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:09.677427 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ca5deb3c-d8c3-4ad5-8af3-60ad6e55b501 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:09.794160 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ca5deb3c-d8c3-4ad5-8af3-60ad6e55b501 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:09.812877 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ca5deb3c-d8c3-4ad5-8af3-60ad6e55b501 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1272 microversion: 2.1 time: 0.152249 Aug 28 10:16:09.815992 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 31/59] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:09 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:09.940241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-7b772c0b-428b-49fa-bd58-28071c61b355 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:09.941642 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-7b772c0b-428b-49fa-bd58-28071c61b355 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:09.953704 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7b772c0b-428b-49fa-bd58-28071c61b355 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:09.955789 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7b772c0b-428b-49fa-bd58-28071c61b355 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:09.956761 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7b772c0b-428b-49fa-bd58-28071c61b355 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:09.957681 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7b772c0b-428b-49fa-bd58-28071c61b355 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:09.959254 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7b772c0b-428b-49fa-bd58-28071c61b355 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:09.960804 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7b772c0b-428b-49fa-bd58-28071c61b355 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:10.125630 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7b772c0b-428b-49fa-bd58-28071c61b355 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:10.134566 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-7b772c0b-428b-49fa-bd58-28071c61b355 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1280 microversion: 2.1 time: 0.198767 Aug 28 10:16:10.149574 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 29/60] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:09 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1280 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:10.292335 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-823a5a35-3320-4cb5-b9fa-6bea8cf6dcac tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:10.293371 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-823a5a35-3320-4cb5-b9fa-6bea8cf6dcac tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:10.299810 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-823a5a35-3320-4cb5-b9fa-6bea8cf6dcac tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:10.300296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-823a5a35-3320-4cb5-b9fa-6bea8cf6dcac tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:10.300819 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-823a5a35-3320-4cb5-b9fa-6bea8cf6dcac tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:10.301682 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-823a5a35-3320-4cb5-b9fa-6bea8cf6dcac tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:10.302237 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-823a5a35-3320-4cb5-b9fa-6bea8cf6dcac tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:10.302791 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-823a5a35-3320-4cb5-b9fa-6bea8cf6dcac tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:10.303655 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=4 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:10.345489 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-9a9f18c0-0669-4647-8be0-ccbed0bbca07 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:10.346098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-9a9f18c0-0669-4647-8be0-ccbed0bbca07 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:10.351428 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:10.353582 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9a9f18c0-0669-4647-8be0-ccbed0bbca07 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:10.354425 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9a9f18c0-0669-4647-8be0-ccbed0bbca07 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:10.355020 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9a9f18c0-0669-4647-8be0-ccbed0bbca07 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:10.355945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9a9f18c0-0669-4647-8be0-ccbed0bbca07 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:10.356695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9a9f18c0-0669-4647-8be0-ccbed0bbca07 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:10.357367 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9a9f18c0-0669-4647-8be0-ccbed0bbca07 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:10.380311 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=100 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:10.512288 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-9a9f18c0-0669-4647-8be0-ccbed0bbca07 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:10.517434 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-823a5a35-3320-4cb5-b9fa-6bea8cf6dcac tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:10.522980 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-9a9f18c0-0669-4647-8be0-ccbed0bbca07 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1300 microversion: 2.1 time: 0.181224 Aug 28 10:16:10.523601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 30/61] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:10 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1300 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:16:10.539569 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:10.554608 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-823a5a35-3320-4cb5-b9fa-6bea8cf6dcac tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:10.558065 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-823a5a35-3320-4cb5-b9fa-6bea8cf6dcac tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:10.561742 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-823a5a35-3320-4cb5-b9fa-6bea8cf6dcac tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1339 microversion: 2.20 time: 0.273251 Aug 28 10:16:10.562579 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:10 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1339 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:10.839138 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e27e27ab-d563-433f-a542-b2e2a2986a0e tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:10.839744 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e27e27ab-d563-433f-a542-b2e2a2986a0e tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:10.846120 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e27e27ab-d563-433f-a542-b2e2a2986a0e tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:10.846609 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e27e27ab-d563-433f-a542-b2e2a2986a0e tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:10.847066 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e27e27ab-d563-433f-a542-b2e2a2986a0e tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:10.847932 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e27e27ab-d563-433f-a542-b2e2a2986a0e tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:10.848381 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e27e27ab-d563-433f-a542-b2e2a2986a0e tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:10.849036 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e27e27ab-d563-433f-a542-b2e2a2986a0e tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:10.951690 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-e27e27ab-d563-433f-a542-b2e2a2986a0e tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:10.965005 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-e27e27ab-d563-433f-a542-b2e2a2986a0e tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1272 microversion: 2.1 time: 0.129621 Aug 28 10:16:10.966496 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 31/63] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:10 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1272 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:11.157443 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-22ec481b-002a-4f53-a2c8-d61c99c3b52e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:11.158064 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-22ec481b-002a-4f53-a2c8-d61c99c3b52e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:11.166808 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-22ec481b-002a-4f53-a2c8-d61c99c3b52e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:11.167301 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-22ec481b-002a-4f53-a2c8-d61c99c3b52e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:11.169515 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-22ec481b-002a-4f53-a2c8-d61c99c3b52e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:11.170340 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-22ec481b-002a-4f53-a2c8-d61c99c3b52e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:11.174948 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-22ec481b-002a-4f53-a2c8-d61c99c3b52e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:11.175686 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-22ec481b-002a-4f53-a2c8-d61c99c3b52e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:11.493722 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-22ec481b-002a-4f53-a2c8-d61c99c3b52e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:11.502369 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-22ec481b-002a-4f53-a2c8-d61c99c3b52e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.348777 Aug 28 10:16:11.512870 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 33/64] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:11 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:11.545477 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-7841cc9d-547e-4973-9bfe-7ec34ab6d06b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:11.546102 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-7841cc9d-547e-4973-9bfe-7ec34ab6d06b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:11.560447 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7841cc9d-547e-4973-9bfe-7ec34ab6d06b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:11.567419 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7841cc9d-547e-4973-9bfe-7ec34ab6d06b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:11.568115 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7841cc9d-547e-4973-9bfe-7ec34ab6d06b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:11.569538 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7841cc9d-547e-4973-9bfe-7ec34ab6d06b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:11.570718 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7841cc9d-547e-4973-9bfe-7ec34ab6d06b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:11.571278 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7841cc9d-547e-4973-9bfe-7ec34ab6d06b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:11.594639 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c1dafd90-2187-4fbf-b175-469279e5fc72 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:11.594845 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c1dafd90-2187-4fbf-b175-469279e5fc72 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:11.606716 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c1dafd90-2187-4fbf-b175-469279e5fc72 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:11.607197 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c1dafd90-2187-4fbf-b175-469279e5fc72 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:11.607614 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c1dafd90-2187-4fbf-b175-469279e5fc72 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:11.608288 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c1dafd90-2187-4fbf-b175-469279e5fc72 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:11.608926 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c1dafd90-2187-4fbf-b175-469279e5fc72 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:11.609331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c1dafd90-2187-4fbf-b175-469279e5fc72 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:11.810235 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=6 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:11.832545 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=24 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:11.889333 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7841cc9d-547e-4973-9bfe-7ec34ab6d06b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:11.911873 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-7841cc9d-547e-4973-9bfe-7ec34ab6d06b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1300 microversion: 2.1 time: 0.370268 Aug 28 10:16:11.913274 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 32/65] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:11 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1300 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:11.990196 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c127525b-dec4-4408-bac5-a2c8eab04ee2 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:11.990840 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c127525b-dec4-4408-bac5-a2c8eab04ee2 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:12.004896 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c127525b-dec4-4408-bac5-a2c8eab04ee2 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:12.005640 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c127525b-dec4-4408-bac5-a2c8eab04ee2 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:12.006260 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c127525b-dec4-4408-bac5-a2c8eab04ee2 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:12.007195 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c127525b-dec4-4408-bac5-a2c8eab04ee2 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:12.008403 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c127525b-dec4-4408-bac5-a2c8eab04ee2 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:12.008993 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c127525b-dec4-4408-bac5-a2c8eab04ee2 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:12.010610 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=22 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:12.203755 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c1dafd90-2187-4fbf-b175-469279e5fc72 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:12.216114 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c1dafd90-2187-4fbf-b175-469279e5fc72 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:12.223976 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c1dafd90-2187-4fbf-b175-469279e5fc72 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:12.226325 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c1dafd90-2187-4fbf-b175-469279e5fc72 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.636345 Aug 28 10:16:12.227940 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:11 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 28 10:16:12.287107 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c127525b-dec4-4408-bac5-a2c8eab04ee2 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:12.295538 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c127525b-dec4-4408-bac5-a2c8eab04ee2 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.309481 Aug 28 10:16:12.296123 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 33/67] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:11 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:12.523290 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-80667aa5-4cd1-4920-8afd-da0307fd520f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:12.523899 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-80667aa5-4cd1-4920-8afd-da0307fd520f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:12.530276 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-80667aa5-4cd1-4920-8afd-da0307fd520f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:12.530756 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-80667aa5-4cd1-4920-8afd-da0307fd520f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:12.531178 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-80667aa5-4cd1-4920-8afd-da0307fd520f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:12.531858 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-80667aa5-4cd1-4920-8afd-da0307fd520f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:12.532302 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-80667aa5-4cd1-4920-8afd-da0307fd520f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:12.532743 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-80667aa5-4cd1-4920-8afd-da0307fd520f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:12.670391 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-80667aa5-4cd1-4920-8afd-da0307fd520f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:12.678253 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-80667aa5-4cd1-4920-8afd-da0307fd520f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.158700 Aug 28 10:16:12.678902 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 35/68] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:12 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:12.940739 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-d9ade479-3134-437b-be89-421f1735a39b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:12.941755 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-d9ade479-3134-437b-be89-421f1735a39b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:12.951931 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d9ade479-3134-437b-be89-421f1735a39b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:12.952776 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d9ade479-3134-437b-be89-421f1735a39b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:12.953486 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d9ade479-3134-437b-be89-421f1735a39b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:12.954611 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d9ade479-3134-437b-be89-421f1735a39b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:12.955355 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d9ade479-3134-437b-be89-421f1735a39b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:12.956064 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d9ade479-3134-437b-be89-421f1735a39b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:13.083371 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d9ade479-3134-437b-be89-421f1735a39b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:13.091398 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-d9ade479-3134-437b-be89-421f1735a39b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.157348 Aug 28 10:16:13.091978 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 34/69] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:12 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:13.254883 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b07cdd62-1437-4850-b110-93144fa0ab7e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:13.255594 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b07cdd62-1437-4850-b110-93144fa0ab7e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:13.263063 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b07cdd62-1437-4850-b110-93144fa0ab7e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:13.263616 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b07cdd62-1437-4850-b110-93144fa0ab7e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:13.264116 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b07cdd62-1437-4850-b110-93144fa0ab7e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:13.264960 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b07cdd62-1437-4850-b110-93144fa0ab7e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:13.265481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b07cdd62-1437-4850-b110-93144fa0ab7e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:13.265971 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b07cdd62-1437-4850-b110-93144fa0ab7e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:13.316563 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4e39ba51-d00e-430e-b3cb-303e46d07580 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:13.317196 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4e39ba51-d00e-430e-b3cb-303e46d07580 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:13.323628 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4e39ba51-d00e-430e-b3cb-303e46d07580 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:13.324110 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4e39ba51-d00e-430e-b3cb-303e46d07580 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:13.324535 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4e39ba51-d00e-430e-b3cb-303e46d07580 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:13.325258 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4e39ba51-d00e-430e-b3cb-303e46d07580 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:13.325708 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4e39ba51-d00e-430e-b3cb-303e46d07580 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:13.326128 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4e39ba51-d00e-430e-b3cb-303e46d07580 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:13.449597 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b07cdd62-1437-4850-b110-93144fa0ab7e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:13.458039 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b07cdd62-1437-4850-b110-93144fa0ab7e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:13.459461 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b07cdd62-1437-4850-b110-93144fa0ab7e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:13.460554 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b07cdd62-1437-4850-b110-93144fa0ab7e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.212367 Aug 28 10:16:13.461139 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:13 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:13.479118 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4e39ba51-d00e-430e-b3cb-303e46d07580 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:13.487183 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4e39ba51-d00e-430e-b3cb-303e46d07580 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.174482 Aug 28 10:16:13.487727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 35/71] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:13 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:13.703153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-78fd90ec-d69f-4432-8cc5-4f220eb18a26 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:13.704225 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-78fd90ec-d69f-4432-8cc5-4f220eb18a26 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:13.712274 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-78fd90ec-d69f-4432-8cc5-4f220eb18a26 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:13.712786 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-78fd90ec-d69f-4432-8cc5-4f220eb18a26 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:13.713208 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-78fd90ec-d69f-4432-8cc5-4f220eb18a26 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:13.713883 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-78fd90ec-d69f-4432-8cc5-4f220eb18a26 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:13.714320 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-78fd90ec-d69f-4432-8cc5-4f220eb18a26 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:13.714727 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-78fd90ec-d69f-4432-8cc5-4f220eb18a26 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:13.848428 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-78fd90ec-d69f-4432-8cc5-4f220eb18a26 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:13.856881 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-78fd90ec-d69f-4432-8cc5-4f220eb18a26 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.160439 Aug 28 10:16:13.857388 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 37/72] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:13 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:14.115241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8c053691-e8a5-4b88-92b4-8d95c529963d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:14.115832 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-8c053691-e8a5-4b88-92b4-8d95c529963d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:14.122342 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8c053691-e8a5-4b88-92b4-8d95c529963d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:14.122814 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8c053691-e8a5-4b88-92b4-8d95c529963d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:14.123236 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8c053691-e8a5-4b88-92b4-8d95c529963d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:14.123912 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8c053691-e8a5-4b88-92b4-8d95c529963d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:14.124350 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8c053691-e8a5-4b88-92b4-8d95c529963d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:14.124795 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8c053691-e8a5-4b88-92b4-8d95c529963d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:14.265520 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8c053691-e8a5-4b88-92b4-8d95c529963d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:14.273783 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-8c053691-e8a5-4b88-92b4-8d95c529963d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.162829 Aug 28 10:16:14.274360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 36/73] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:14 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:14.487218 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e26dfccc-9743-4b0b-88e2-b17fcfa171b0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:14.488004 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e26dfccc-9743-4b0b-88e2-b17fcfa171b0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:14.492789 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:14.502860 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e26dfccc-9743-4b0b-88e2-b17fcfa171b0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:14.503666 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e26dfccc-9743-4b0b-88e2-b17fcfa171b0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:14.504387 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e26dfccc-9743-4b0b-88e2-b17fcfa171b0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:14.505347 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e26dfccc-9743-4b0b-88e2-b17fcfa171b0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:14.505793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e26dfccc-9743-4b0b-88e2-b17fcfa171b0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:14.506197 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e26dfccc-9743-4b0b-88e2-b17fcfa171b0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:14.509409 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8e97fc69-0815-4ff6-a2a7-e66eb997cbad tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:14.510010 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-8e97fc69-0815-4ff6-a2a7-e66eb997cbad tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:14.516292 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e97fc69-0815-4ff6-a2a7-e66eb997cbad tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:14.516796 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e97fc69-0815-4ff6-a2a7-e66eb997cbad tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:14.517212 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e97fc69-0815-4ff6-a2a7-e66eb997cbad tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:14.517887 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e97fc69-0815-4ff6-a2a7-e66eb997cbad tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:14.518342 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e97fc69-0815-4ff6-a2a7-e66eb997cbad tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:14.518725 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e97fc69-0815-4ff6-a2a7-e66eb997cbad tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:14.704714 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e26dfccc-9743-4b0b-88e2-b17fcfa171b0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:14.711768 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8e97fc69-0815-4ff6-a2a7-e66eb997cbad tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:14.713161 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e26dfccc-9743-4b0b-88e2-b17fcfa171b0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:14.714628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e26dfccc-9743-4b0b-88e2-b17fcfa171b0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:14.715693 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e26dfccc-9743-4b0b-88e2-b17fcfa171b0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.235295 Aug 28 10:16:14.716282 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 38/74] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:14 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:14.719680 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-8e97fc69-0815-4ff6-a2a7-e66eb997cbad tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.214274 Aug 28 10:16:14.720230 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 37/75] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:14 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:14.880861 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4d84a1d2-4112-4c57-980f-969e9fdde983 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:14.881697 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4d84a1d2-4112-4c57-980f-969e9fdde983 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:14.890374 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d84a1d2-4112-4c57-980f-969e9fdde983 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:14.891033 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d84a1d2-4112-4c57-980f-969e9fdde983 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:14.891616 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d84a1d2-4112-4c57-980f-969e9fdde983 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:14.892694 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d84a1d2-4112-4c57-980f-969e9fdde983 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:14.893347 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d84a1d2-4112-4c57-980f-969e9fdde983 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:14.894236 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d84a1d2-4112-4c57-980f-969e9fdde983 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:15.034517 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4d84a1d2-4112-4c57-980f-969e9fdde983 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:15.043089 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4d84a1d2-4112-4c57-980f-969e9fdde983 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.168351 Aug 28 10:16:15.043682 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 39/76] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:14 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:15.295011 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4406d436-8e5d-4de2-b22d-d4074a93d174 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:15.295742 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4406d436-8e5d-4de2-b22d-d4074a93d174 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:15.302071 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4406d436-8e5d-4de2-b22d-d4074a93d174 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:15.302542 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4406d436-8e5d-4de2-b22d-d4074a93d174 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:15.302955 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4406d436-8e5d-4de2-b22d-d4074a93d174 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:15.303635 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4406d436-8e5d-4de2-b22d-d4074a93d174 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:15.304070 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4406d436-8e5d-4de2-b22d-d4074a93d174 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:15.304475 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4406d436-8e5d-4de2-b22d-d4074a93d174 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:15.443434 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4406d436-8e5d-4de2-b22d-d4074a93d174 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:15.451247 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4406d436-8e5d-4de2-b22d-d4074a93d174 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.160284 Aug 28 10:16:15.451819 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 38/77] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:15 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:15.740258 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3d5b4fde-f6fb-4fbf-8829-0e9a914696a4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:15.741340 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3d5b4fde-f6fb-4fbf-8829-0e9a914696a4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:15.741834 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8d2b5142-2b00-4ba6-9a18-6bb81fca958b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:15.742613 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-8d2b5142-2b00-4ba6-9a18-6bb81fca958b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:15.749176 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8d2b5142-2b00-4ba6-9a18-6bb81fca958b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:15.749900 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8d2b5142-2b00-4ba6-9a18-6bb81fca958b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:15.750064 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8d2b5142-2b00-4ba6-9a18-6bb81fca958b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:15.750837 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8d2b5142-2b00-4ba6-9a18-6bb81fca958b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:15.751340 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8d2b5142-2b00-4ba6-9a18-6bb81fca958b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:15.751923 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8d2b5142-2b00-4ba6-9a18-6bb81fca958b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:15.752047 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3d5b4fde-f6fb-4fbf-8829-0e9a914696a4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:15.752626 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3d5b4fde-f6fb-4fbf-8829-0e9a914696a4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:15.753111 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3d5b4fde-f6fb-4fbf-8829-0e9a914696a4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:15.754014 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3d5b4fde-f6fb-4fbf-8829-0e9a914696a4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:15.754508 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3d5b4fde-f6fb-4fbf-8829-0e9a914696a4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:15.755193 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3d5b4fde-f6fb-4fbf-8829-0e9a914696a4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:16.032877 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3d5b4fde-f6fb-4fbf-8829-0e9a914696a4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:16.041491 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3d5b4fde-f6fb-4fbf-8829-0e9a914696a4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:16.042874 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3d5b4fde-f6fb-4fbf-8829-0e9a914696a4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:16.044274 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3d5b4fde-f6fb-4fbf-8829-0e9a914696a4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.308547 Aug 28 10:16:16.044871 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 40/78] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:15 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:16.049528 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8d2b5142-2b00-4ba6-9a18-6bb81fca958b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:16.063189 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-8d2b5142-2b00-4ba6-9a18-6bb81fca958b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.325895 Aug 28 10:16:16.064135 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 39/79] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:15 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:16.068450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-55e0b3f1-256b-460e-9e0e-a2b31b232796 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:16.069543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-55e0b3f1-256b-460e-9e0e-a2b31b232796 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:16.078298 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-55e0b3f1-256b-460e-9e0e-a2b31b232796 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:16.079959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-55e0b3f1-256b-460e-9e0e-a2b31b232796 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:16.080764 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-55e0b3f1-256b-460e-9e0e-a2b31b232796 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:16.081869 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-55e0b3f1-256b-460e-9e0e-a2b31b232796 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:16.082499 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-55e0b3f1-256b-460e-9e0e-a2b31b232796 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:16.083405 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-55e0b3f1-256b-460e-9e0e-a2b31b232796 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:16.234043 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-55e0b3f1-256b-460e-9e0e-a2b31b232796 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:16.242920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-55e0b3f1-256b-460e-9e0e-a2b31b232796 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.183094 Aug 28 10:16:16.243588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 41/80] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:16 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:16.471386 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-abb5b72a-8e91-4ed3-ad58-dbfecd5d255b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:16.473001 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-abb5b72a-8e91-4ed3-ad58-dbfecd5d255b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:16.479576 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-abb5b72a-8e91-4ed3-ad58-dbfecd5d255b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:16.480169 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-abb5b72a-8e91-4ed3-ad58-dbfecd5d255b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:16.480699 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-abb5b72a-8e91-4ed3-ad58-dbfecd5d255b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:16.481478 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-abb5b72a-8e91-4ed3-ad58-dbfecd5d255b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:16.481992 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-abb5b72a-8e91-4ed3-ad58-dbfecd5d255b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:16.482469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-abb5b72a-8e91-4ed3-ad58-dbfecd5d255b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:16.623899 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-abb5b72a-8e91-4ed3-ad58-dbfecd5d255b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:16.632554 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-abb5b72a-8e91-4ed3-ad58-dbfecd5d255b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.165058 Aug 28 10:16:16.633259 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 40/81] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:16 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:17.071888 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-619d6a2b-2ca3-4f1e-bab7-ca639ca0cca6 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:17.072735 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-619d6a2b-2ca3-4f1e-bab7-ca639ca0cca6 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:17.088876 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-619d6a2b-2ca3-4f1e-bab7-ca639ca0cca6 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:17.088876 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-619d6a2b-2ca3-4f1e-bab7-ca639ca0cca6 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:17.088876 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-619d6a2b-2ca3-4f1e-bab7-ca639ca0cca6 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:17.088876 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-619d6a2b-2ca3-4f1e-bab7-ca639ca0cca6 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:17.089159 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-619d6a2b-2ca3-4f1e-bab7-ca639ca0cca6 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:17.089159 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-619d6a2b-2ca3-4f1e-bab7-ca639ca0cca6 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:17.093272 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-5ad4f10f-068e-44e2-943d-87489f6580eb tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:17.093926 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-5ad4f10f-068e-44e2-943d-87489f6580eb tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:17.100278 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5ad4f10f-068e-44e2-943d-87489f6580eb tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:17.103303 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5ad4f10f-068e-44e2-943d-87489f6580eb tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:17.103961 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5ad4f10f-068e-44e2-943d-87489f6580eb tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:17.105874 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5ad4f10f-068e-44e2-943d-87489f6580eb tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:17.109417 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5ad4f10f-068e-44e2-943d-87489f6580eb tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:17.114177 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5ad4f10f-068e-44e2-943d-87489f6580eb tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:17.378150 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-5ad4f10f-068e-44e2-943d-87489f6580eb tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:17.389133 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-5ad4f10f-068e-44e2-943d-87489f6580eb tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.307492 Aug 28 10:16:17.391112 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 41/82] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:17 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:17.392174 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-619d6a2b-2ca3-4f1e-bab7-ca639ca0cca6 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:17.397355 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-3c46f969-7137-413d-abee-5afe8a56ae5c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:17.398190 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-3c46f969-7137-413d-abee-5afe8a56ae5c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:17.413464 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-619d6a2b-2ca3-4f1e-bab7-ca639ca0cca6 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:17.417201 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-619d6a2b-2ca3-4f1e-bab7-ca639ca0cca6 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:17.417835 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3c46f969-7137-413d-abee-5afe8a56ae5c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:17.418920 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3c46f969-7137-413d-abee-5afe8a56ae5c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:17.419538 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3c46f969-7137-413d-abee-5afe8a56ae5c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:17.420719 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3c46f969-7137-413d-abee-5afe8a56ae5c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:17.421330 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-619d6a2b-2ca3-4f1e-bab7-ca639ca0cca6 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.354736 Aug 28 10:16:17.421477 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3c46f969-7137-413d-abee-5afe8a56ae5c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:17.422053 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 42/83] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:17 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:17.436986 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3c46f969-7137-413d-abee-5afe8a56ae5c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:17.599645 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-3c46f969-7137-413d-abee-5afe8a56ae5c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:17.607356 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-3c46f969-7137-413d-abee-5afe8a56ae5c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.215096 Aug 28 10:16:17.608159 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 42/84] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:17 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:17.654100 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a46bad1b-d321-4e2f-992a-624633016cf5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:17.654695 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a46bad1b-d321-4e2f-992a-624633016cf5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:17.660794 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a46bad1b-d321-4e2f-992a-624633016cf5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:17.661264 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a46bad1b-d321-4e2f-992a-624633016cf5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:17.661681 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a46bad1b-d321-4e2f-992a-624633016cf5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:17.662350 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a46bad1b-d321-4e2f-992a-624633016cf5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:17.662784 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a46bad1b-d321-4e2f-992a-624633016cf5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:17.663187 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a46bad1b-d321-4e2f-992a-624633016cf5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:17.795050 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a46bad1b-d321-4e2f-992a-624633016cf5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:17.803222 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a46bad1b-d321-4e2f-992a-624633016cf5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.153137 Aug 28 10:16:17.803797 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 43/85] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:17 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:18.421427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-d7fd65bc-160e-4978-bf77-fdaf377fca92 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:18.422438 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-d7fd65bc-160e-4978-bf77-fdaf377fca92 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:18.433442 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d7fd65bc-160e-4978-bf77-fdaf377fca92 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:18.434034 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d7fd65bc-160e-4978-bf77-fdaf377fca92 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:18.434494 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d7fd65bc-160e-4978-bf77-fdaf377fca92 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:18.435290 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d7fd65bc-160e-4978-bf77-fdaf377fca92 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:18.435795 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d7fd65bc-160e-4978-bf77-fdaf377fca92 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:18.436644 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d7fd65bc-160e-4978-bf77-fdaf377fca92 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:18.448524 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-25ee608b-884c-4878-b8bd-f1a9f0ed1536 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:18.449159 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-25ee608b-884c-4878-b8bd-f1a9f0ed1536 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:18.460079 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25ee608b-884c-4878-b8bd-f1a9f0ed1536 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:18.460796 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25ee608b-884c-4878-b8bd-f1a9f0ed1536 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:18.461572 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25ee608b-884c-4878-b8bd-f1a9f0ed1536 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:18.464198 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25ee608b-884c-4878-b8bd-f1a9f0ed1536 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:18.465167 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25ee608b-884c-4878-b8bd-f1a9f0ed1536 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:18.465758 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25ee608b-884c-4878-b8bd-f1a9f0ed1536 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:18.726919 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-25ee608b-884c-4878-b8bd-f1a9f0ed1536 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:18.731871 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d7fd65bc-160e-4978-bf77-fdaf377fca92 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:18.737935 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-25ee608b-884c-4878-b8bd-f1a9f0ed1536 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:18.739715 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-25ee608b-884c-4878-b8bd-f1a9f0ed1536 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:18.740886 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-25ee608b-884c-4878-b8bd-f1a9f0ed1536 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.296414 Aug 28 10:16:18.741676 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 44/86] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:18 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 28 10:16:18.743017 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-d7fd65bc-160e-4978-bf77-fdaf377fca92 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.328883 Aug 28 10:16:18.743595 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 43/87] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:18 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:18.747047 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0b90cd50-e999-4731-9b58-c0dfa2f9e080 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:18.747643 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0b90cd50-e999-4731-9b58-c0dfa2f9e080 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:18.771810 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b90cd50-e999-4731-9b58-c0dfa2f9e080 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:18.772312 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b90cd50-e999-4731-9b58-c0dfa2f9e080 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:18.772967 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b90cd50-e999-4731-9b58-c0dfa2f9e080 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:18.773757 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b90cd50-e999-4731-9b58-c0dfa2f9e080 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:18.774204 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b90cd50-e999-4731-9b58-c0dfa2f9e080 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:18.774618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b90cd50-e999-4731-9b58-c0dfa2f9e080 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:18.824971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-37b216e6-7794-4e8d-acda-be22c0d9dc08 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:18.825573 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-37b216e6-7794-4e8d-acda-be22c0d9dc08 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:18.836124 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-37b216e6-7794-4e8d-acda-be22c0d9dc08 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:18.836657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-37b216e6-7794-4e8d-acda-be22c0d9dc08 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:18.837103 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-37b216e6-7794-4e8d-acda-be22c0d9dc08 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:18.837804 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-37b216e6-7794-4e8d-acda-be22c0d9dc08 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:18.838296 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-37b216e6-7794-4e8d-acda-be22c0d9dc08 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:18.838675 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-37b216e6-7794-4e8d-acda-be22c0d9dc08 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:19.047269 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0b90cd50-e999-4731-9b58-c0dfa2f9e080 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:19.055858 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-37b216e6-7794-4e8d-acda-be22c0d9dc08 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:19.070748 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0b90cd50-e999-4731-9b58-c0dfa2f9e080 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.327464 Aug 28 10:16:19.071664 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 45/88] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:18 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:19.073831 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-37b216e6-7794-4e8d-acda-be22c0d9dc08 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.253518 Aug 28 10:16:19.074679 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 44/89] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:18 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:19.768146 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-882a7000-c7e3-4d34-a919-808b1a8540aa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:19.769131 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-882a7000-c7e3-4d34-a919-808b1a8540aa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:19.779405 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-882a7000-c7e3-4d34-a919-808b1a8540aa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:19.780227 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-882a7000-c7e3-4d34-a919-808b1a8540aa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:19.780979 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-882a7000-c7e3-4d34-a919-808b1a8540aa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:19.781213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f084aa19-36fc-4c2a-b280-7922f7a3d36e tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:19.782091 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f084aa19-36fc-4c2a-b280-7922f7a3d36e tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:19.782260 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-882a7000-c7e3-4d34-a919-808b1a8540aa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:19.782817 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-882a7000-c7e3-4d34-a919-808b1a8540aa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:19.783503 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-882a7000-c7e3-4d34-a919-808b1a8540aa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:19.790055 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f084aa19-36fc-4c2a-b280-7922f7a3d36e tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:19.790517 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f084aa19-36fc-4c2a-b280-7922f7a3d36e tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:19.791088 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f084aa19-36fc-4c2a-b280-7922f7a3d36e tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:19.791764 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f084aa19-36fc-4c2a-b280-7922f7a3d36e tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:19.792204 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f084aa19-36fc-4c2a-b280-7922f7a3d36e tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:19.792652 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f084aa19-36fc-4c2a-b280-7922f7a3d36e tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:19.980172 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-882a7000-c7e3-4d34-a919-808b1a8540aa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:19.984621 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f084aa19-36fc-4c2a-b280-7922f7a3d36e tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:19.988532 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-882a7000-c7e3-4d34-a919-808b1a8540aa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:19.990029 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-882a7000-c7e3-4d34-a919-808b1a8540aa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:19.991162 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-882a7000-c7e3-4d34-a919-808b1a8540aa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.229624 Aug 28 10:16:19.991725 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 46/90] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:19 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:19.992450 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f084aa19-36fc-4c2a-b280-7922f7a3d36e tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.218148 Aug 28 10:16:19.993085 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 45/91] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:19 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:20.100452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7a11676d-fa94-4778-969b-38aca48b4671 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:20.101727 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7a11676d-fa94-4778-969b-38aca48b4671 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:20.102961 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-2c79a231-84db-429b-89ac-396c097b8cf3 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:20.104253 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-2c79a231-84db-429b-89ac-396c097b8cf3 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:20.112701 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a11676d-fa94-4778-969b-38aca48b4671 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:20.113759 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2c79a231-84db-429b-89ac-396c097b8cf3 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:20.114421 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a11676d-fa94-4778-969b-38aca48b4671 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:20.114536 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2c79a231-84db-429b-89ac-396c097b8cf3 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:20.114946 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2c79a231-84db-429b-89ac-396c097b8cf3 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:20.115628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a11676d-fa94-4778-969b-38aca48b4671 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:20.115745 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2c79a231-84db-429b-89ac-396c097b8cf3 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:20.116223 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2c79a231-84db-429b-89ac-396c097b8cf3 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:20.116662 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2c79a231-84db-429b-89ac-396c097b8cf3 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:20.117108 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a11676d-fa94-4778-969b-38aca48b4671 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:20.117648 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a11676d-fa94-4778-969b-38aca48b4671 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:20.118258 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a11676d-fa94-4778-969b-38aca48b4671 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:20.308043 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7a11676d-fa94-4778-969b-38aca48b4671 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:20.311173 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-2c79a231-84db-429b-89ac-396c097b8cf3 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:20.316387 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7a11676d-fa94-4778-969b-38aca48b4671 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.223665 Aug 28 10:16:20.317534 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 47/92] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:20 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:20.319134 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-2c79a231-84db-429b-89ac-396c097b8cf3 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.222420 Aug 28 10:16:20.319694 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 46/93] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:20 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:21.012923 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-32e7426b-f29a-4db3-8a19-e17181e3f265 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:21.013523 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c9abe00c-2a08-4f89-9e52-c65c80421441 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:21.013909 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-32e7426b-f29a-4db3-8a19-e17181e3f265 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:21.013993 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c9abe00c-2a08-4f89-9e52-c65c80421441 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:21.019748 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c9abe00c-2a08-4f89-9e52-c65c80421441 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:21.019934 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-32e7426b-f29a-4db3-8a19-e17181e3f265 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:21.020218 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c9abe00c-2a08-4f89-9e52-c65c80421441 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:21.020413 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-32e7426b-f29a-4db3-8a19-e17181e3f265 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:21.020703 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c9abe00c-2a08-4f89-9e52-c65c80421441 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:21.020873 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-32e7426b-f29a-4db3-8a19-e17181e3f265 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:21.021347 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c9abe00c-2a08-4f89-9e52-c65c80421441 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:21.021558 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-32e7426b-f29a-4db3-8a19-e17181e3f265 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:21.021787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c9abe00c-2a08-4f89-9e52-c65c80421441 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:21.022003 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-32e7426b-f29a-4db3-8a19-e17181e3f265 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:21.022264 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c9abe00c-2a08-4f89-9e52-c65c80421441 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:21.022420 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-32e7426b-f29a-4db3-8a19-e17181e3f265 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:21.026256 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=100 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:21.223687 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-32e7426b-f29a-4db3-8a19-e17181e3f265 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:21.227482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c9abe00c-2a08-4f89-9e52-c65c80421441 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:21.237198 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c9abe00c-2a08-4f89-9e52-c65c80421441 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:21.238911 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c9abe00c-2a08-4f89-9e52-c65c80421441 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:21.240231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c9abe00c-2a08-4f89-9e52-c65c80421441 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.231154 Aug 28 10:16:21.240354 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-32e7426b-f29a-4db3-8a19-e17181e3f265 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.231071 Aug 28 10:16:21.245078 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 48/94] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:21 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:21.245661 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 47/95] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:21 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 28 10:16:21.339222 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8f6d51bd-5cf6-4ad5-9c52-67033faac772 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:21.339751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-364da3f3-999b-48b9-9ea0-e96b7aea87b5 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:21.340361 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-364da3f3-999b-48b9-9ea0-e96b7aea87b5 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:21.340589 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8f6d51bd-5cf6-4ad5-9c52-67033faac772 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:21.347123 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f6d51bd-5cf6-4ad5-9c52-67033faac772 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:21.347835 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f6d51bd-5cf6-4ad5-9c52-67033faac772 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:21.347957 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-364da3f3-999b-48b9-9ea0-e96b7aea87b5 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:21.348323 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-364da3f3-999b-48b9-9ea0-e96b7aea87b5 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:21.348762 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f6d51bd-5cf6-4ad5-9c52-67033faac772 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:21.348884 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-364da3f3-999b-48b9-9ea0-e96b7aea87b5 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:21.349615 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-364da3f3-999b-48b9-9ea0-e96b7aea87b5 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:21.349978 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f6d51bd-5cf6-4ad5-9c52-67033faac772 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:21.350087 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-364da3f3-999b-48b9-9ea0-e96b7aea87b5 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:21.350469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-364da3f3-999b-48b9-9ea0-e96b7aea87b5 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:21.350928 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f6d51bd-5cf6-4ad5-9c52-67033faac772 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:21.351497 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f6d51bd-5cf6-4ad5-9c52-67033faac772 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:21.375118 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:21.559674 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-364da3f3-999b-48b9-9ea0-e96b7aea87b5 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:21.566145 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8f6d51bd-5cf6-4ad5-9c52-67033faac772 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:21.570054 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-364da3f3-999b-48b9-9ea0-e96b7aea87b5 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.233904 Aug 28 10:16:21.575277 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 48/96] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:21 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:21.577725 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8f6d51bd-5cf6-4ad5-9c52-67033faac772 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.242514 Aug 28 10:16:21.578907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 49/97] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:21 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:22.260456 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8a77d845-44a1-4d3f-ada4-459a2e84cd11 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:22.263760 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-8a77d845-44a1-4d3f-ada4-459a2e84cd11 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:22.266014 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c8e3f4c5-dacd-40dc-b30b-8049b950caef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:22.266587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c8e3f4c5-dacd-40dc-b30b-8049b950caef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:22.270934 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8a77d845-44a1-4d3f-ada4-459a2e84cd11 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:22.271601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8a77d845-44a1-4d3f-ada4-459a2e84cd11 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:22.272133 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8a77d845-44a1-4d3f-ada4-459a2e84cd11 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:22.272815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8e3f4c5-dacd-40dc-b30b-8049b950caef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:22.273062 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8a77d845-44a1-4d3f-ada4-459a2e84cd11 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:22.273289 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8e3f4c5-dacd-40dc-b30b-8049b950caef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:22.273680 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8a77d845-44a1-4d3f-ada4-459a2e84cd11 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:22.273771 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8e3f4c5-dacd-40dc-b30b-8049b950caef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:22.274265 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8a77d845-44a1-4d3f-ada4-459a2e84cd11 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:22.274362 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8e3f4c5-dacd-40dc-b30b-8049b950caef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:22.274812 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8e3f4c5-dacd-40dc-b30b-8049b950caef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:22.275241 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8e3f4c5-dacd-40dc-b30b-8049b950caef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:22.467676 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c8e3f4c5-dacd-40dc-b30b-8049b950caef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:22.470974 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8a77d845-44a1-4d3f-ada4-459a2e84cd11 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:22.478136 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c8e3f4c5-dacd-40dc-b30b-8049b950caef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:22.479941 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c8e3f4c5-dacd-40dc-b30b-8049b950caef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:22.480542 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-8a77d845-44a1-4d3f-ada4-459a2e84cd11 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.223784 Aug 28 10:16:22.481683 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 49/98] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:22 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:22.488094 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c8e3f4c5-dacd-40dc-b30b-8049b950caef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.219254 Aug 28 10:16:22.488726 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 50/99] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:22 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:22.591116 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-eb9c4728-4d45-46ca-aa1f-abb33b64d1fd tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:22.591730 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-eb9c4728-4d45-46ca-aa1f-abb33b64d1fd tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:22.598089 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-eb9c4728-4d45-46ca-aa1f-abb33b64d1fd tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:22.598284 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cb6e740b-b46f-47f9-93d0-7835aa166ed7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:22.598565 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-eb9c4728-4d45-46ca-aa1f-abb33b64d1fd tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:22.598699 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cb6e740b-b46f-47f9-93d0-7835aa166ed7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:22.598990 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-eb9c4728-4d45-46ca-aa1f-abb33b64d1fd tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:22.599749 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-eb9c4728-4d45-46ca-aa1f-abb33b64d1fd tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:22.600196 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-eb9c4728-4d45-46ca-aa1f-abb33b64d1fd tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:22.600640 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-eb9c4728-4d45-46ca-aa1f-abb33b64d1fd tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:22.604820 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cb6e740b-b46f-47f9-93d0-7835aa166ed7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:22.605290 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cb6e740b-b46f-47f9-93d0-7835aa166ed7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:22.605714 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cb6e740b-b46f-47f9-93d0-7835aa166ed7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:22.606398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cb6e740b-b46f-47f9-93d0-7835aa166ed7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:22.606836 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cb6e740b-b46f-47f9-93d0-7835aa166ed7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:22.607247 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cb6e740b-b46f-47f9-93d0-7835aa166ed7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:22.809122 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-eb9c4728-4d45-46ca-aa1f-abb33b64d1fd tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:22.816531 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cb6e740b-b46f-47f9-93d0-7835aa166ed7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:22.817249 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-eb9c4728-4d45-46ca-aa1f-abb33b64d1fd tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.229834 Aug 28 10:16:22.818020 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 50/100] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:22 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:22.826797 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cb6e740b-b46f-47f9-93d0-7835aa166ed7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.232204 Aug 28 10:16:22.832118 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 51/101] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:22 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:16:23.501470 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f706204c-2a58-45bb-b4d4-2c108f03678f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:23.502067 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f706204c-2a58-45bb-b4d4-2c108f03678f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:23.508527 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f706204c-2a58-45bb-b4d4-2c108f03678f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:23.509036 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f706204c-2a58-45bb-b4d4-2c108f03678f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:23.509463 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f706204c-2a58-45bb-b4d4-2c108f03678f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:23.510118 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f706204c-2a58-45bb-b4d4-2c108f03678f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:23.510580 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f706204c-2a58-45bb-b4d4-2c108f03678f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:23.510978 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f706204c-2a58-45bb-b4d4-2c108f03678f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:23.513814 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-655ba6c3-10b3-4afd-b72a-82d4f5158860 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:23.514397 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-655ba6c3-10b3-4afd-b72a-82d4f5158860 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:23.520782 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-655ba6c3-10b3-4afd-b72a-82d4f5158860 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:23.521484 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-655ba6c3-10b3-4afd-b72a-82d4f5158860 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:23.522092 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-655ba6c3-10b3-4afd-b72a-82d4f5158860 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:23.523239 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-655ba6c3-10b3-4afd-b72a-82d4f5158860 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:23.523808 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-655ba6c3-10b3-4afd-b72a-82d4f5158860 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:23.524344 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-655ba6c3-10b3-4afd-b72a-82d4f5158860 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:23.845215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f706204c-2a58-45bb-b4d4-2c108f03678f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:23.853303 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f706204c-2a58-45bb-b4d4-2c108f03678f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.355706 Aug 28 10:16:23.853881 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 51/102] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:23 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:23.858385 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-63263de3-909d-4c38-891b-1911fff49d5a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:23.858985 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-63263de3-909d-4c38-891b-1911fff49d5a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:23.859101 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-655ba6c3-10b3-4afd-b72a-82d4f5158860 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:23.864946 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-63263de3-909d-4c38-891b-1911fff49d5a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:23.865582 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-63263de3-909d-4c38-891b-1911fff49d5a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:23.866008 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-63263de3-909d-4c38-891b-1911fff49d5a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:23.866692 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-63263de3-909d-4c38-891b-1911fff49d5a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:23.867137 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-63263de3-909d-4c38-891b-1911fff49d5a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:23.867241 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-655ba6c3-10b3-4afd-b72a-82d4f5158860 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:23.867657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-63263de3-909d-4c38-891b-1911fff49d5a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:23.868703 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-655ba6c3-10b3-4afd-b72a-82d4f5158860 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:23.869788 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-655ba6c3-10b3-4afd-b72a-82d4f5158860 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.359881 Aug 28 10:16:23.870525 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 52/103] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:23 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:23.875215 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ab32065d-ecb0-4b1b-89c5-adcee48357c3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:23.876468 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ab32065d-ecb0-4b1b-89c5-adcee48357c3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:23.895771 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ab32065d-ecb0-4b1b-89c5-adcee48357c3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:23.896653 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ab32065d-ecb0-4b1b-89c5-adcee48357c3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:23.897225 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ab32065d-ecb0-4b1b-89c5-adcee48357c3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:23.898070 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ab32065d-ecb0-4b1b-89c5-adcee48357c3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:23.898653 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ab32065d-ecb0-4b1b-89c5-adcee48357c3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:23.899212 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ab32065d-ecb0-4b1b-89c5-adcee48357c3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:24.068100 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-63263de3-909d-4c38-891b-1911fff49d5a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:24.077492 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-63263de3-909d-4c38-891b-1911fff49d5a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.222625 Aug 28 10:16:24.078205 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 52/104] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:23 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:24.080117 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ab32065d-ecb0-4b1b-89c5-adcee48357c3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:24.088211 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ab32065d-ecb0-4b1b-89c5-adcee48357c3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.216756 Aug 28 10:16:24.088835 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 53/105] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:23 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:24.876709 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4eb6dc9f-39c6-4f91-a14e-13ee03b6507b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:24.877401 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4eb6dc9f-39c6-4f91-a14e-13ee03b6507b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:24.884472 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4eb6dc9f-39c6-4f91-a14e-13ee03b6507b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:24.885045 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4eb6dc9f-39c6-4f91-a14e-13ee03b6507b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:24.885462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4eb6dc9f-39c6-4f91-a14e-13ee03b6507b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:24.886137 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4eb6dc9f-39c6-4f91-a14e-13ee03b6507b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:24.886568 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4eb6dc9f-39c6-4f91-a14e-13ee03b6507b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:24.886971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4eb6dc9f-39c6-4f91-a14e-13ee03b6507b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:24.895404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c194e456-a547-4430-9e0c-641807b02cd8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:24.895992 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c194e456-a547-4430-9e0c-641807b02cd8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:24.902569 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c194e456-a547-4430-9e0c-641807b02cd8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:24.903504 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c194e456-a547-4430-9e0c-641807b02cd8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:24.904152 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c194e456-a547-4430-9e0c-641807b02cd8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:24.905139 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c194e456-a547-4430-9e0c-641807b02cd8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:24.905686 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c194e456-a547-4430-9e0c-641807b02cd8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:24.906202 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c194e456-a547-4430-9e0c-641807b02cd8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:25.102401 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4eb6dc9f-39c6-4f91-a14e-13ee03b6507b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:25.105708 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c194e456-a547-4430-9e0c-641807b02cd8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:25.118554 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c194e456-a547-4430-9e0c-641807b02cd8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:25.120060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c194e456-a547-4430-9e0c-641807b02cd8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:25.121085 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c194e456-a547-4430-9e0c-641807b02cd8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.229859 Aug 28 10:16:25.127027 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4eb6dc9f-39c6-4f91-a14e-13ee03b6507b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.244371 Aug 28 10:16:25.136548 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 53/106] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:24 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:25.136548 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-13b35909-410d-4e24-919f-c3f89f432baf tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:25.136548 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-13b35909-410d-4e24-919f-c3f89f432baf tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:25.137093 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 54/107] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:24 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 28 10:16:25.140742 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5c302e73-3120-4cfb-a041-ab8da90d4de1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:25.141373 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5c302e73-3120-4cfb-a041-ab8da90d4de1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:25.141751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-13b35909-410d-4e24-919f-c3f89f432baf tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:25.142223 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-13b35909-410d-4e24-919f-c3f89f432baf tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:25.142666 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-13b35909-410d-4e24-919f-c3f89f432baf tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:25.143326 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-13b35909-410d-4e24-919f-c3f89f432baf tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:25.143768 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-13b35909-410d-4e24-919f-c3f89f432baf tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:25.144180 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-13b35909-410d-4e24-919f-c3f89f432baf tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:25.147326 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c302e73-3120-4cfb-a041-ab8da90d4de1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:25.147801 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c302e73-3120-4cfb-a041-ab8da90d4de1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:25.148609 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c302e73-3120-4cfb-a041-ab8da90d4de1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:25.149047 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c302e73-3120-4cfb-a041-ab8da90d4de1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:25.149484 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c302e73-3120-4cfb-a041-ab8da90d4de1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:25.149898 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c302e73-3120-4cfb-a041-ab8da90d4de1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:25.340764 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-13b35909-410d-4e24-919f-c3f89f432baf tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:25.350615 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-13b35909-410d-4e24-919f-c3f89f432baf tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.221698 Aug 28 10:16:25.351080 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5c302e73-3120-4cfb-a041-ab8da90d4de1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:25.360991 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5c302e73-3120-4cfb-a041-ab8da90d4de1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.224365 Aug 28 10:16:25.361780 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 55/108] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:25 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:25.364623 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 54/109] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:25 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:26.146144 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5c7f3f9a-235a-4f47-b694-d8eaf249d7bc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:26.146144 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5c7f3f9a-235a-4f47-b694-d8eaf249d7bc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:26.150026 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-dcb43353-1e95-482b-a013-2f764ccd7934 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:26.151101 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c7f3f9a-235a-4f47-b694-d8eaf249d7bc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:26.151589 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c7f3f9a-235a-4f47-b694-d8eaf249d7bc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:26.152022 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c7f3f9a-235a-4f47-b694-d8eaf249d7bc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:26.152398 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-dcb43353-1e95-482b-a013-2f764ccd7934 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:26.152733 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c7f3f9a-235a-4f47-b694-d8eaf249d7bc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:26.153186 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c7f3f9a-235a-4f47-b694-d8eaf249d7bc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:26.153601 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c7f3f9a-235a-4f47-b694-d8eaf249d7bc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:26.160392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-dcb43353-1e95-482b-a013-2f764ccd7934 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:26.161401 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-dcb43353-1e95-482b-a013-2f764ccd7934 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:26.162050 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-dcb43353-1e95-482b-a013-2f764ccd7934 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:26.163247 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-dcb43353-1e95-482b-a013-2f764ccd7934 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:26.164258 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-dcb43353-1e95-482b-a013-2f764ccd7934 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:26.165111 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-dcb43353-1e95-482b-a013-2f764ccd7934 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:26.369135 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5c7f3f9a-235a-4f47-b694-d8eaf249d7bc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:26.378641 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5c7f3f9a-235a-4f47-b694-d8eaf249d7bc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:26.378954 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-dcb43353-1e95-482b-a013-2f764ccd7934 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:26.380099 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5c7f3f9a-235a-4f47-b694-d8eaf249d7bc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:26.381266 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5c7f3f9a-235a-4f47-b694-d8eaf249d7bc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.241942 Aug 28 10:16:26.381831 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 56/110] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:26 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:26.387097 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-dcb43353-1e95-482b-a013-2f764ccd7934 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.242599 Aug 28 10:16:26.387660 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 55/111] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:26 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:16:26.392128 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c760ea2b-6ff8-4137-aa21-e2a8da820021 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:26.392742 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c760ea2b-6ff8-4137-aa21-e2a8da820021 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:26.398532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c760ea2b-6ff8-4137-aa21-e2a8da820021 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:26.399001 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c760ea2b-6ff8-4137-aa21-e2a8da820021 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:26.399583 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c760ea2b-6ff8-4137-aa21-e2a8da820021 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:26.400274 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c760ea2b-6ff8-4137-aa21-e2a8da820021 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:26.400757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c760ea2b-6ff8-4137-aa21-e2a8da820021 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:26.401151 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c760ea2b-6ff8-4137-aa21-e2a8da820021 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:26.401332 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c6eb9c51-24ec-49a9-aa59-2faa0124176c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:26.402300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c6eb9c51-24ec-49a9-aa59-2faa0124176c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:26.408853 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6eb9c51-24ec-49a9-aa59-2faa0124176c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:26.409453 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6eb9c51-24ec-49a9-aa59-2faa0124176c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:26.410003 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6eb9c51-24ec-49a9-aa59-2faa0124176c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:26.410700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6eb9c51-24ec-49a9-aa59-2faa0124176c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:26.411140 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6eb9c51-24ec-49a9-aa59-2faa0124176c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:26.411560 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6eb9c51-24ec-49a9-aa59-2faa0124176c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:26.600620 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c760ea2b-6ff8-4137-aa21-e2a8da820021 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:26.610644 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c760ea2b-6ff8-4137-aa21-e2a8da820021 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.221862 Aug 28 10:16:26.620643 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c6eb9c51-24ec-49a9-aa59-2faa0124176c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:26.621617 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 56/112] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:26 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:26.624993 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c6eb9c51-24ec-49a9-aa59-2faa0124176c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.227701 Aug 28 10:16:26.625603 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 57/113] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:26 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:27.403199 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4fad7bd4-62e8-4c39-8fd7-d8b29af4053f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:27.404167 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4fad7bd4-62e8-4c39-8fd7-d8b29af4053f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:27.407491 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-02aaa136-d3e8-4d16-ab0a-c3c96fa5800c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:27.408103 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-02aaa136-d3e8-4d16-ab0a-c3c96fa5800c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:27.410827 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4fad7bd4-62e8-4c39-8fd7-d8b29af4053f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:27.411284 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4fad7bd4-62e8-4c39-8fd7-d8b29af4053f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:27.411760 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4fad7bd4-62e8-4c39-8fd7-d8b29af4053f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:27.412472 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4fad7bd4-62e8-4c39-8fd7-d8b29af4053f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:27.412950 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4fad7bd4-62e8-4c39-8fd7-d8b29af4053f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:27.413367 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4fad7bd4-62e8-4c39-8fd7-d8b29af4053f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:27.425766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-02aaa136-d3e8-4d16-ab0a-c3c96fa5800c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:27.426429 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-02aaa136-d3e8-4d16-ab0a-c3c96fa5800c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:27.426994 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-02aaa136-d3e8-4d16-ab0a-c3c96fa5800c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:27.428210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-02aaa136-d3e8-4d16-ab0a-c3c96fa5800c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:27.428864 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-02aaa136-d3e8-4d16-ab0a-c3c96fa5800c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:27.429516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-02aaa136-d3e8-4d16-ab0a-c3c96fa5800c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:27.741964 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-02aaa136-d3e8-4d16-ab0a-c3c96fa5800c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:27.756189 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-02aaa136-d3e8-4d16-ab0a-c3c96fa5800c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.352614 Aug 28 10:16:27.757887 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 58/114] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:27 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:16:27.766291 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4fad7bd4-62e8-4c39-8fd7-d8b29af4053f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:27.788222 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f28bc7b6-2dd8-41e5-b8d3-850c888de24f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:27.790855 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f28bc7b6-2dd8-41e5-b8d3-850c888de24f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:27.794812 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4fad7bd4-62e8-4c39-8fd7-d8b29af4053f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:27.796933 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4fad7bd4-62e8-4c39-8fd7-d8b29af4053f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:27.800543 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4fad7bd4-62e8-4c39-8fd7-d8b29af4053f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.401301 Aug 28 10:16:27.805056 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f28bc7b6-2dd8-41e5-b8d3-850c888de24f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:27.807305 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 57/115] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:27 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:27.813748 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f28bc7b6-2dd8-41e5-b8d3-850c888de24f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:27.814961 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f28bc7b6-2dd8-41e5-b8d3-850c888de24f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:27.816606 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f28bc7b6-2dd8-41e5-b8d3-850c888de24f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:27.818237 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f28bc7b6-2dd8-41e5-b8d3-850c888de24f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:27.819839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-3ff356ad-fd8a-4aa8-998f-580ef289225c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:27.820330 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f28bc7b6-2dd8-41e5-b8d3-850c888de24f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:27.823673 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-3ff356ad-fd8a-4aa8-998f-580ef289225c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:27.844960 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3ff356ad-fd8a-4aa8-998f-580ef289225c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:27.852697 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3ff356ad-fd8a-4aa8-998f-580ef289225c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:27.853244 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3ff356ad-fd8a-4aa8-998f-580ef289225c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:27.854146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3ff356ad-fd8a-4aa8-998f-580ef289225c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:27.854746 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3ff356ad-fd8a-4aa8-998f-580ef289225c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:27.856033 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3ff356ad-fd8a-4aa8-998f-580ef289225c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:28.449586 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f28bc7b6-2dd8-41e5-b8d3-850c888de24f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:28.457270 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f28bc7b6-2dd8-41e5-b8d3-850c888de24f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.698028 Aug 28 10:16:28.471960 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 59/116] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:27 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:28.724555 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-3ff356ad-fd8a-4aa8-998f-580ef289225c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:28.738259 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-3ff356ad-fd8a-4aa8-998f-580ef289225c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.928504 Aug 28 10:16:28.739288 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 58/117] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:27 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:28.795566 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8dd5d0dc-4a73-4835-8705-dd6319010c36 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:28.796527 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8dd5d0dc-4a73-4835-8705-dd6319010c36 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:28.805310 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8dd5d0dc-4a73-4835-8705-dd6319010c36 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:28.806024 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8dd5d0dc-4a73-4835-8705-dd6319010c36 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:28.806581 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8dd5d0dc-4a73-4835-8705-dd6319010c36 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:28.807624 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8dd5d0dc-4a73-4835-8705-dd6319010c36 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:28.808211 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8dd5d0dc-4a73-4835-8705-dd6319010c36 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:28.808886 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8dd5d0dc-4a73-4835-8705-dd6319010c36 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:28.833711 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-12bf8e5a-08f5-4027-aeaf-4d129aa0fc85 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:28.834613 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-12bf8e5a-08f5-4027-aeaf-4d129aa0fc85 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:28.842993 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-12bf8e5a-08f5-4027-aeaf-4d129aa0fc85 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:28.843828 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-12bf8e5a-08f5-4027-aeaf-4d129aa0fc85 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:28.844475 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-12bf8e5a-08f5-4027-aeaf-4d129aa0fc85 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:28.845415 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-12bf8e5a-08f5-4027-aeaf-4d129aa0fc85 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:28.846051 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-12bf8e5a-08f5-4027-aeaf-4d129aa0fc85 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:28.846654 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-12bf8e5a-08f5-4027-aeaf-4d129aa0fc85 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:29.312772 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8dd5d0dc-4a73-4835-8705-dd6319010c36 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:29.321391 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-12bf8e5a-08f5-4027-aeaf-4d129aa0fc85 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:29.327813 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8dd5d0dc-4a73-4835-8705-dd6319010c36 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.542823 Aug 28 10:16:29.343454 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 60/118] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:28 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:29.343674 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-12bf8e5a-08f5-4027-aeaf-4d129aa0fc85 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:29.350009 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-12bf8e5a-08f5-4027-aeaf-4d129aa0fc85 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:29.351412 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-12bf8e5a-08f5-4027-aeaf-4d129aa0fc85 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.524056 Aug 28 10:16:29.352594 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 59/119] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:28 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:29.447461 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-c45605d9-aa85-41ff-9dcc-2ca63437137c req-65d0c46e-b065-4b72-9106-b3863478c800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a0819fc-2347-457b-804f-7ef819596193", "tag": "fe1c34ee-5586-4bd0-a9a5-7cc7349b7bd2"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:16:29.461620 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c45605d9-aa85-41ff-9dcc-2ca63437137c req-65d0c46e-b065-4b72-9106-b3863478c800 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:29.462744 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c45605d9-aa85-41ff-9dcc-2ca63437137c req-65d0c46e-b065-4b72-9106-b3863478c800 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:29.463631 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c45605d9-aa85-41ff-9dcc-2ca63437137c req-65d0c46e-b065-4b72-9106-b3863478c800 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:29.478372 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-283f1421-9e59-4c4c-aed0-82d4368eb4b0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:29.479332 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-283f1421-9e59-4c4c-aed0-82d4368eb4b0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:29.489584 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-283f1421-9e59-4c4c-aed0-82d4368eb4b0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:29.490415 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-283f1421-9e59-4c4c-aed0-82d4368eb4b0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:29.493748 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-283f1421-9e59-4c4c-aed0-82d4368eb4b0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:29.494768 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-283f1421-9e59-4c4c-aed0-82d4368eb4b0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:29.495880 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-283f1421-9e59-4c4c-aed0-82d4368eb4b0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:29.496530 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-283f1421-9e59-4c4c-aed0-82d4368eb4b0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:29.504201 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-c45605d9-aa85-41ff-9dcc-2ca63437137c req-65d0c46e-b065-4b72-9106-b3863478c800 service nova] Creating event network-changed:fe1c34ee-5586-4bd0-a9a5-7cc7349b7bd2 for instance 2a0819fc-2347-457b-804f-7ef819596193 on hv-cinder-85200 Aug 28 10:16:29.517310 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c45605d9-aa85-41ff-9dcc-2ca63437137c req-65d0c46e-b065-4b72-9106-b3863478c800 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120663) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 28 10:16:29.518045 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c45605d9-aa85-41ff-9dcc-2ca63437137c req-65d0c46e-b065-4b72-9106-b3863478c800 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120663) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 28 10:16:29.519330 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-45ea5ad8-2aad-42fe-93b7-f46b4849edd8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:29.520022 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-45ea5ad8-2aad-42fe-93b7-f46b4849edd8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:29.520682 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-45ea5ad8-2aad-42fe-93b7-f46b4849edd8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:29.521605 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-45ea5ad8-2aad-42fe-93b7-f46b4849edd8 None None] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:29.526548 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-45ea5ad8-2aad-42fe-93b7-f46b4849edd8 None None] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:29.527227 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-45ea5ad8-2aad-42fe-93b7-f46b4849edd8 None None] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:29.546285 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.compute.rpcapi [None req-45ea5ad8-2aad-42fe-93b7-f46b4849edd8 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 28 10:16:29.548291 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-45ea5ad8-2aad-42fe-93b7-f46b4849edd8 None None] Releasing lock "compute-rpcapi-router" {{(pid=120663) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 28 10:16:29.568008 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-45ea5ad8-2aad-42fe-93b7-f46b4849edd8 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.229650 Aug 28 10:16:29.568940 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 61/120] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:16:29.723575 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-1064ad37-7dd4-4952-8968-10bd6db26857 req-e750947d-fdf2-4857-a15f-48396bb519d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5016c8b-754f-45cf-b06d-a76bc62afb13", "tag": "4ac906a4-9f4d-413f-b675-c5b1fa08afbb"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:16:29.733319 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-1064ad37-7dd4-4952-8968-10bd6db26857 req-e750947d-fdf2-4857-a15f-48396bb519d6 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:29.734016 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-1064ad37-7dd4-4952-8968-10bd6db26857 req-e750947d-fdf2-4857-a15f-48396bb519d6 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:29.734619 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-1064ad37-7dd4-4952-8968-10bd6db26857 req-e750947d-fdf2-4857-a15f-48396bb519d6 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:29.745702 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-1064ad37-7dd4-4952-8968-10bd6db26857 req-e750947d-fdf2-4857-a15f-48396bb519d6 service nova] Creating event network-changed:4ac906a4-9f4d-413f-b675-c5b1fa08afbb for instance a5016c8b-754f-45cf-b06d-a76bc62afb13 on hv-cinder-85200 Aug 28 10:16:29.750351 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-1064ad37-7dd4-4952-8968-10bd6db26857 req-e750947d-fdf2-4857-a15f-48396bb519d6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092982 Aug 28 10:16:29.751095 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 62/121] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:16:29.759012 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2c38a3c1-0166-4f9e-a513-f2200995b14c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:29.759693 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2c38a3c1-0166-4f9e-a513-f2200995b14c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:29.765837 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c38a3c1-0166-4f9e-a513-f2200995b14c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:29.766313 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c38a3c1-0166-4f9e-a513-f2200995b14c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:29.766734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c38a3c1-0166-4f9e-a513-f2200995b14c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:29.767414 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c38a3c1-0166-4f9e-a513-f2200995b14c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:29.767850 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c38a3c1-0166-4f9e-a513-f2200995b14c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:29.768256 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c38a3c1-0166-4f9e-a513-f2200995b14c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:29.795605 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-283f1421-9e59-4c4c-aed0-82d4368eb4b0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:29.803333 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-283f1421-9e59-4c4c-aed0-82d4368eb4b0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.329117 Aug 28 10:16:29.803903 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 60/122] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:29 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:29.900177 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2c38a3c1-0166-4f9e-a513-f2200995b14c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:29.912285 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2c38a3c1-0166-4f9e-a513-f2200995b14c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.156879 Aug 28 10:16:29.913263 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 63/123] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:29 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:30.352291 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-b35a76d0-032a-4caf-9335-a345a7f66ce6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:30.352934 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-b35a76d0-032a-4caf-9335-a345a7f66ce6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:30.359372 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b35a76d0-032a-4caf-9335-a345a7f66ce6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:30.359854 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b35a76d0-032a-4caf-9335-a345a7f66ce6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:30.360280 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b35a76d0-032a-4caf-9335-a345a7f66ce6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:30.361000 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b35a76d0-032a-4caf-9335-a345a7f66ce6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:30.361438 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b35a76d0-032a-4caf-9335-a345a7f66ce6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:30.361854 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b35a76d0-032a-4caf-9335-a345a7f66ce6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:30.375269 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-58fb4837-2b00-496a-9d54-cd977c611a08 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:30.375872 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-58fb4837-2b00-496a-9d54-cd977c611a08 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:30.382210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-58fb4837-2b00-496a-9d54-cd977c611a08 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:30.382686 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-58fb4837-2b00-496a-9d54-cd977c611a08 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:30.383107 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-58fb4837-2b00-496a-9d54-cd977c611a08 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:30.383782 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-58fb4837-2b00-496a-9d54-cd977c611a08 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:30.384224 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-58fb4837-2b00-496a-9d54-cd977c611a08 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:30.384663 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-58fb4837-2b00-496a-9d54-cd977c611a08 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:30.561788 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-b35a76d0-032a-4caf-9335-a345a7f66ce6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:30.565817 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-58fb4837-2b00-496a-9d54-cd977c611a08 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:30.569992 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-b35a76d0-032a-4caf-9335-a345a7f66ce6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.221571 Aug 28 10:16:30.570546 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 61/124] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:30 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:30.573944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-58fb4837-2b00-496a-9d54-cd977c611a08 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:30.575355 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-58fb4837-2b00-496a-9d54-cd977c611a08 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:30.576433 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-58fb4837-2b00-496a-9d54-cd977c611a08 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.205053 Aug 28 10:16:30.576997 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 64/125] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:30 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:30.827615 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-d2304b34-275a-450f-826e-bf16576f8892 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:30.828441 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-d2304b34-275a-450f-826e-bf16576f8892 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:30.838721 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d2304b34-275a-450f-826e-bf16576f8892 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:30.839497 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d2304b34-275a-450f-826e-bf16576f8892 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:30.840187 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d2304b34-275a-450f-826e-bf16576f8892 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:30.841356 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d2304b34-275a-450f-826e-bf16576f8892 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:30.842077 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d2304b34-275a-450f-826e-bf16576f8892 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:30.843234 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d2304b34-275a-450f-826e-bf16576f8892 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:30.939211 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-472280aa-2252-40c0-be7f-6c1979dc681b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:30.940337 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-472280aa-2252-40c0-be7f-6c1979dc681b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:30.947449 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-472280aa-2252-40c0-be7f-6c1979dc681b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:30.948276 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-472280aa-2252-40c0-be7f-6c1979dc681b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:30.949040 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-472280aa-2252-40c0-be7f-6c1979dc681b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:30.950112 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-472280aa-2252-40c0-be7f-6c1979dc681b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:30.950950 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-472280aa-2252-40c0-be7f-6c1979dc681b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:30.951646 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-472280aa-2252-40c0-be7f-6c1979dc681b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:30.988082 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d2304b34-275a-450f-826e-bf16576f8892 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:31.000340 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-d2304b34-275a-450f-826e-bf16576f8892 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.179338 Aug 28 10:16:31.000980 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 62/126] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:30 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:31.083487 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-472280aa-2252-40c0-be7f-6c1979dc681b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:31.091685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-472280aa-2252-40c0-be7f-6c1979dc681b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.156266 Aug 28 10:16:31.092304 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 65/127] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:30 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:31.593693 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4ecd22c7-999e-49a0-98c5-72118a8eaf47 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:31.594507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4ecd22c7-999e-49a0-98c5-72118a8eaf47 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:31.596300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-58e0f4e8-105c-44fd-b939-cfdbbf260e98 req-f36bb7f9-0895-4784-81e0-4d65fe62c606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4", "tag": "a3a7c610-6f76-4e40-86da-4aaffb9925dd"}, {"name": "network-changed", "server_uuid": "c703c468-fcfc-41a1-ae56-4b9a516378ed", "tag": "f4f9d7ba-0d95-4c3b-b146-58f4b088e007"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:16:31.600905 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4ecd22c7-999e-49a0-98c5-72118a8eaf47 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:31.601345 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4ecd22c7-999e-49a0-98c5-72118a8eaf47 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:31.602019 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4ecd22c7-999e-49a0-98c5-72118a8eaf47 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:31.602746 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4ecd22c7-999e-49a0-98c5-72118a8eaf47 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:31.603182 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4ecd22c7-999e-49a0-98c5-72118a8eaf47 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:31.603620 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4ecd22c7-999e-49a0-98c5-72118a8eaf47 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:31.607695 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-58e0f4e8-105c-44fd-b939-cfdbbf260e98 req-f36bb7f9-0895-4784-81e0-4d65fe62c606 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:31.608269 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-58e0f4e8-105c-44fd-b939-cfdbbf260e98 req-f36bb7f9-0895-4784-81e0-4d65fe62c606 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:31.608878 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-58e0f4e8-105c-44fd-b939-cfdbbf260e98 req-f36bb7f9-0895-4784-81e0-4d65fe62c606 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:31.621666 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-58e0f4e8-105c-44fd-b939-cfdbbf260e98 req-f36bb7f9-0895-4784-81e0-4d65fe62c606 service nova] Creating event network-changed:a3a7c610-6f76-4e40-86da-4aaffb9925dd for instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 on hv-cinder-85200 Aug 28 10:16:31.622214 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-58e0f4e8-105c-44fd-b939-cfdbbf260e98 req-f36bb7f9-0895-4784-81e0-4d65fe62c606 service nova] Creating event network-changed:f4f9d7ba-0d95-4c3b-b146-58f4b088e007 for instance c703c468-fcfc-41a1-ae56-4b9a516378ed on hv-cinder-85200 Aug 28 10:16:31.628541 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-58e0f4e8-105c-44fd-b939-cfdbbf260e98 req-f36bb7f9-0895-4784-81e0-4d65fe62c606 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038173 Aug 28 10:16:31.629315 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 66/128] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:16:31.634478 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9e0c1dad-a3c0-406b-8ee2-03b1eab881d2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:31.635213 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9e0c1dad-a3c0-406b-8ee2-03b1eab881d2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:31.641609 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e0c1dad-a3c0-406b-8ee2-03b1eab881d2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:31.642055 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e0c1dad-a3c0-406b-8ee2-03b1eab881d2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:31.642734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e0c1dad-a3c0-406b-8ee2-03b1eab881d2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:31.643423 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e0c1dad-a3c0-406b-8ee2-03b1eab881d2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:31.643867 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e0c1dad-a3c0-406b-8ee2-03b1eab881d2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:31.644293 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e0c1dad-a3c0-406b-8ee2-03b1eab881d2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:31.964130 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4ecd22c7-999e-49a0-98c5-72118a8eaf47 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:31.967678 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=100 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:31.972903 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4ecd22c7-999e-49a0-98c5-72118a8eaf47 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.383037 Aug 28 10:16:31.973471 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 63/129] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:31 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:31.978286 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-c4360071-df46-45d5-bdf1-704a6b4db840 req-bba59676-8608-4130-90a0-77be9fff2ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c41bc126-2936-43a3-a819-e9433bb7f8f4", "tag": "f3149d41-a93c-4c32-b02d-c9686354c16c"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:16:31.992199 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-c4360071-df46-45d5-bdf1-704a6b4db840 req-bba59676-8608-4130-90a0-77be9fff2ed5 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:31.993147 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-c4360071-df46-45d5-bdf1-704a6b4db840 req-bba59676-8608-4130-90a0-77be9fff2ed5 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:31.993619 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-c4360071-df46-45d5-bdf1-704a6b4db840 req-bba59676-8608-4130-90a0-77be9fff2ed5 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:32.014947 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-c4360071-df46-45d5-bdf1-704a6b4db840 req-bba59676-8608-4130-90a0-77be9fff2ed5 service nova] Creating event network-changed:f3149d41-a93c-4c32-b02d-c9686354c16c for instance c41bc126-2936-43a3-a819-e9433bb7f8f4 on hv-cinder-85200 Aug 28 10:16:32.015733 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-c4360071-df46-45d5-bdf1-704a6b4db840 req-bba59676-8608-4130-90a0-77be9fff2ed5 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120664) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 28 10:16:32.016367 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-c4360071-df46-45d5-bdf1-704a6b4db840 req-bba59676-8608-4130-90a0-77be9fff2ed5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120664) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 28 10:16:32.017770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-83d79d17-4817-415c-85dd-1db59ba7420e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:32.018461 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-83d79d17-4817-415c-85dd-1db59ba7420e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:32.019662 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-83d79d17-4817-415c-85dd-1db59ba7420e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:32.020249 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-83d79d17-4817-415c-85dd-1db59ba7420e None None] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:32.020816 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-83d79d17-4817-415c-85dd-1db59ba7420e None None] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:32.021389 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-83d79d17-4817-415c-85dd-1db59ba7420e None None] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:32.047291 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.compute.rpcapi [None req-83d79d17-4817-415c-85dd-1db59ba7420e None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 28 10:16:32.055831 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-83d79d17-4817-415c-85dd-1db59ba7420e None None] Releasing lock "compute-rpcapi-router" {{(pid=120664) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 28 10:16:32.081679 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-83d79d17-4817-415c-85dd-1db59ba7420e None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106670 Aug 28 10:16:32.083763 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 64/130] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:16:32.106266 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9e0c1dad-a3c0-406b-8ee2-03b1eab881d2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:32.106679 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-ce1f2d4e-cfda-4790-8eb8-db7483f5be91 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:32.107675 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-ce1f2d4e-cfda-4790-8eb8-db7483f5be91 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:32.110059 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:32.116253 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ce1f2d4e-cfda-4790-8eb8-db7483f5be91 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:32.116456 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9e0c1dad-a3c0-406b-8ee2-03b1eab881d2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:32.118228 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9e0c1dad-a3c0-406b-8ee2-03b1eab881d2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:32.118949 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ce1f2d4e-cfda-4790-8eb8-db7483f5be91 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:32.119394 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ce1f2d4e-cfda-4790-8eb8-db7483f5be91 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:32.120011 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9e0c1dad-a3c0-406b-8ee2-03b1eab881d2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.489414 Aug 28 10:16:32.120117 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ce1f2d4e-cfda-4790-8eb8-db7483f5be91 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:32.123140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ce1f2d4e-cfda-4790-8eb8-db7483f5be91 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:32.123860 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ce1f2d4e-cfda-4790-8eb8-db7483f5be91 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:32.132572 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 67/131] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:31 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:32.144219 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-67b5bcc4-6354-4df7-8cdd-57f22fa85ef3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:32.144861 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-67b5bcc4-6354-4df7-8cdd-57f22fa85ef3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:32.151156 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67b5bcc4-6354-4df7-8cdd-57f22fa85ef3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:32.151637 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67b5bcc4-6354-4df7-8cdd-57f22fa85ef3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:32.152231 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67b5bcc4-6354-4df7-8cdd-57f22fa85ef3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:32.153092 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67b5bcc4-6354-4df7-8cdd-57f22fa85ef3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:32.153677 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67b5bcc4-6354-4df7-8cdd-57f22fa85ef3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:32.154261 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67b5bcc4-6354-4df7-8cdd-57f22fa85ef3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:32.698735 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-ce1f2d4e-cfda-4790-8eb8-db7483f5be91 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:32.706567 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-ce1f2d4e-cfda-4790-8eb8-db7483f5be91 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.621601 Aug 28 10:16:32.707147 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 65/132] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:32 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:32.742850 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-67b5bcc4-6354-4df7-8cdd-57f22fa85ef3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:32.750535 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-67b5bcc4-6354-4df7-8cdd-57f22fa85ef3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.611356 Aug 28 10:16:32.751108 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 68/133] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:32 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:32.998065 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-97e94af6-9e3d-419a-b7c6-5ac21aa59e7b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:32.998846 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-97e94af6-9e3d-419a-b7c6-5ac21aa59e7b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:33.007809 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-97e94af6-9e3d-419a-b7c6-5ac21aa59e7b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:33.008279 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-97e94af6-9e3d-419a-b7c6-5ac21aa59e7b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:33.008733 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-97e94af6-9e3d-419a-b7c6-5ac21aa59e7b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:33.009402 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-97e94af6-9e3d-419a-b7c6-5ac21aa59e7b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:33.009835 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-97e94af6-9e3d-419a-b7c6-5ac21aa59e7b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:33.010243 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-97e94af6-9e3d-419a-b7c6-5ac21aa59e7b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:33.140918 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-97e94af6-9e3d-419a-b7c6-5ac21aa59e7b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:33.146546 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ab69b043-7819-4d08-9489-de3f329bfdcc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:33.147313 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ab69b043-7819-4d08-9489-de3f329bfdcc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:33.149458 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-97e94af6-9e3d-419a-b7c6-5ac21aa59e7b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.157961 Aug 28 10:16:33.150221 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 66/134] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:32 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:33.166284 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ab69b043-7819-4d08-9489-de3f329bfdcc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:33.166757 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ab69b043-7819-4d08-9489-de3f329bfdcc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:33.167149 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ab69b043-7819-4d08-9489-de3f329bfdcc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:33.167858 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ab69b043-7819-4d08-9489-de3f329bfdcc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:33.168317 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ab69b043-7819-4d08-9489-de3f329bfdcc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:33.168749 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ab69b043-7819-4d08-9489-de3f329bfdcc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:33.311319 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ab69b043-7819-4d08-9489-de3f329bfdcc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:33.324005 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ab69b043-7819-4d08-9489-de3f329bfdcc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:33.326314 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ab69b043-7819-4d08-9489-de3f329bfdcc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:33.328064 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ab69b043-7819-4d08-9489-de3f329bfdcc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.185492 Aug 28 10:16:33.329002 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 69/135] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:33 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:33.727418 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-0c637a5f-0d3c-453d-bde8-1a943ead825c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:33.728051 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-0c637a5f-0d3c-453d-bde8-1a943ead825c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:33.734948 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0c637a5f-0d3c-453d-bde8-1a943ead825c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:33.735454 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0c637a5f-0d3c-453d-bde8-1a943ead825c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:33.735850 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0c637a5f-0d3c-453d-bde8-1a943ead825c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:33.736775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0c637a5f-0d3c-453d-bde8-1a943ead825c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:33.737231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0c637a5f-0d3c-453d-bde8-1a943ead825c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:33.737638 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0c637a5f-0d3c-453d-bde8-1a943ead825c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:33.770397 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-688e9e1a-5fe7-4595-967d-8c4b1a050863 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:33.770950 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-688e9e1a-5fe7-4595-967d-8c4b1a050863 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:33.777185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-688e9e1a-5fe7-4595-967d-8c4b1a050863 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:33.777600 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-688e9e1a-5fe7-4595-967d-8c4b1a050863 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:33.778019 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-688e9e1a-5fe7-4595-967d-8c4b1a050863 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:33.778730 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-688e9e1a-5fe7-4595-967d-8c4b1a050863 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:33.779165 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-688e9e1a-5fe7-4595-967d-8c4b1a050863 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:33.779581 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-688e9e1a-5fe7-4595-967d-8c4b1a050863 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:33.917362 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-0c637a5f-0d3c-453d-bde8-1a943ead825c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:33.925350 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-0c637a5f-0d3c-453d-bde8-1a943ead825c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.201887 Aug 28 10:16:33.925917 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 67/136] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:33 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:33.946202 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-688e9e1a-5fe7-4595-967d-8c4b1a050863 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:33.953946 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-688e9e1a-5fe7-4595-967d-8c4b1a050863 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.187329 Aug 28 10:16:33.954501 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 70/137] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:33 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:34.174788 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-bdd7dc47-ed16-4fcc-9cbc-f546846e25c0 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:34.175821 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-bdd7dc47-ed16-4fcc-9cbc-f546846e25c0 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:34.183537 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-bdd7dc47-ed16-4fcc-9cbc-f546846e25c0 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:34.184009 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-bdd7dc47-ed16-4fcc-9cbc-f546846e25c0 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:34.184429 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-bdd7dc47-ed16-4fcc-9cbc-f546846e25c0 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:34.185157 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-bdd7dc47-ed16-4fcc-9cbc-f546846e25c0 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:34.185598 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-bdd7dc47-ed16-4fcc-9cbc-f546846e25c0 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:34.186011 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-bdd7dc47-ed16-4fcc-9cbc-f546846e25c0 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:34.316635 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-bdd7dc47-ed16-4fcc-9cbc-f546846e25c0 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:34.324359 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-bdd7dc47-ed16-4fcc-9cbc-f546846e25c0 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.156147 Aug 28 10:16:34.324936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 68/138] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:34 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:34.350356 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-39e0945e-9c47-495a-9f0c-3dbd0bed6989 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:34.350986 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-39e0945e-9c47-495a-9f0c-3dbd0bed6989 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:34.357037 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39e0945e-9c47-495a-9f0c-3dbd0bed6989 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:34.357512 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39e0945e-9c47-495a-9f0c-3dbd0bed6989 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:34.357933 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39e0945e-9c47-495a-9f0c-3dbd0bed6989 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:34.358613 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39e0945e-9c47-495a-9f0c-3dbd0bed6989 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:34.359059 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39e0945e-9c47-495a-9f0c-3dbd0bed6989 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:34.359467 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39e0945e-9c47-495a-9f0c-3dbd0bed6989 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:34.502606 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-39e0945e-9c47-495a-9f0c-3dbd0bed6989 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:34.511054 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-39e0945e-9c47-495a-9f0c-3dbd0bed6989 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:34.512483 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-39e0945e-9c47-495a-9f0c-3dbd0bed6989 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:34.513598 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-39e0945e-9c47-495a-9f0c-3dbd0bed6989 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.167746 Aug 28 10:16:34.514133 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 71/139] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:34 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:34.950160 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f4307fdf-10a0-4449-953a-f5a771d89592 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:34.951146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f4307fdf-10a0-4449-953a-f5a771d89592 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:34.961106 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f4307fdf-10a0-4449-953a-f5a771d89592 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:34.961584 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f4307fdf-10a0-4449-953a-f5a771d89592 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:34.962008 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f4307fdf-10a0-4449-953a-f5a771d89592 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:34.962692 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f4307fdf-10a0-4449-953a-f5a771d89592 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:34.963142 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f4307fdf-10a0-4449-953a-f5a771d89592 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:34.963556 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f4307fdf-10a0-4449-953a-f5a771d89592 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:34.974284 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e2d7e17e-507c-4abf-9e63-1bfdd36230c3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:34.974879 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e2d7e17e-507c-4abf-9e63-1bfdd36230c3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:34.981194 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e2d7e17e-507c-4abf-9e63-1bfdd36230c3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:34.981668 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e2d7e17e-507c-4abf-9e63-1bfdd36230c3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:34.982105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e2d7e17e-507c-4abf-9e63-1bfdd36230c3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:34.982778 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e2d7e17e-507c-4abf-9e63-1bfdd36230c3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:34.983218 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e2d7e17e-507c-4abf-9e63-1bfdd36230c3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:34.983623 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e2d7e17e-507c-4abf-9e63-1bfdd36230c3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:35.167450 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f4307fdf-10a0-4449-953a-f5a771d89592 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:35.175282 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f4307fdf-10a0-4449-953a-f5a771d89592 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.231575 Aug 28 10:16:35.175883 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 69/140] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:34 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:35.179067 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e2d7e17e-507c-4abf-9e63-1bfdd36230c3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:35.186997 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e2d7e17e-507c-4abf-9e63-1bfdd36230c3 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.216527 Aug 28 10:16:35.187563 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 72/141] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:34 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:35.344471 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-a5508693-6ce5-4e62-82df-11fb0303f34f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:35.345119 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-a5508693-6ce5-4e62-82df-11fb0303f34f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:35.351469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a5508693-6ce5-4e62-82df-11fb0303f34f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:35.351955 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a5508693-6ce5-4e62-82df-11fb0303f34f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:35.352377 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a5508693-6ce5-4e62-82df-11fb0303f34f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:35.353115 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a5508693-6ce5-4e62-82df-11fb0303f34f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:35.353610 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a5508693-6ce5-4e62-82df-11fb0303f34f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:35.353997 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a5508693-6ce5-4e62-82df-11fb0303f34f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:35.494662 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-a5508693-6ce5-4e62-82df-11fb0303f34f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:35.505098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-a5508693-6ce5-4e62-82df-11fb0303f34f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.164544 Aug 28 10:16:35.505791 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 70/142] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:35 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:35.536808 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-075b3d6f-5498-4d84-8430-69107478317d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:35.537543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-075b3d6f-5498-4d84-8430-69107478317d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:35.544324 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-075b3d6f-5498-4d84-8430-69107478317d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:35.544926 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-075b3d6f-5498-4d84-8430-69107478317d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:35.545412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-075b3d6f-5498-4d84-8430-69107478317d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:35.546182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-075b3d6f-5498-4d84-8430-69107478317d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:35.546712 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-075b3d6f-5498-4d84-8430-69107478317d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:35.547221 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-075b3d6f-5498-4d84-8430-69107478317d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:35.679179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-075b3d6f-5498-4d84-8430-69107478317d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:35.687861 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-075b3d6f-5498-4d84-8430-69107478317d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:35.689323 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-075b3d6f-5498-4d84-8430-69107478317d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:35.690426 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-075b3d6f-5498-4d84-8430-69107478317d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.157778 Aug 28 10:16:35.690984 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 73/143] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:35 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:36.195860 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-eca499c8-1822-4f3f-a225-acca2058535e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:36.196410 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-eca499c8-1822-4f3f-a225-acca2058535e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:36.202618 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-eca499c8-1822-4f3f-a225-acca2058535e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:36.203091 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-eca499c8-1822-4f3f-a225-acca2058535e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:36.205110 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-eca499c8-1822-4f3f-a225-acca2058535e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:36.205110 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-eca499c8-1822-4f3f-a225-acca2058535e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:36.205110 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-eca499c8-1822-4f3f-a225-acca2058535e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:36.205110 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-eca499c8-1822-4f3f-a225-acca2058535e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:36.210519 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-94783d12-4fd2-445e-9a9a-1e96f78f8b07 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:36.211731 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-94783d12-4fd2-445e-9a9a-1e96f78f8b07 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:36.218489 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-94783d12-4fd2-445e-9a9a-1e96f78f8b07 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:36.219421 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-94783d12-4fd2-445e-9a9a-1e96f78f8b07 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:36.220044 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-94783d12-4fd2-445e-9a9a-1e96f78f8b07 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:36.220966 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-94783d12-4fd2-445e-9a9a-1e96f78f8b07 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:36.221609 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-94783d12-4fd2-445e-9a9a-1e96f78f8b07 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:36.222273 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-94783d12-4fd2-445e-9a9a-1e96f78f8b07 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:36.475566 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-eca499c8-1822-4f3f-a225-acca2058535e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:36.479168 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-94783d12-4fd2-445e-9a9a-1e96f78f8b07 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:36.483613 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-eca499c8-1822-4f3f-a225-acca2058535e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.291986 Aug 28 10:16:36.484190 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 71/144] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:36 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:36.487271 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-94783d12-4fd2-445e-9a9a-1e96f78f8b07 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.280767 Aug 28 10:16:36.488004 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 74/145] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:36 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:16:36.526131 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-36000205-180f-46a4-bccc-f85f6a3a1a57 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:36.526803 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-36000205-180f-46a4-bccc-f85f6a3a1a57 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:36.532670 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-36000205-180f-46a4-bccc-f85f6a3a1a57 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:36.533145 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-36000205-180f-46a4-bccc-f85f6a3a1a57 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:36.533564 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-36000205-180f-46a4-bccc-f85f6a3a1a57 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:36.534226 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-36000205-180f-46a4-bccc-f85f6a3a1a57 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:36.534665 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-36000205-180f-46a4-bccc-f85f6a3a1a57 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:36.535070 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-36000205-180f-46a4-bccc-f85f6a3a1a57 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:36.667854 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-36000205-180f-46a4-bccc-f85f6a3a1a57 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:36.676807 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-36000205-180f-46a4-bccc-f85f6a3a1a57 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.154479 Aug 28 10:16:36.677371 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 72/146] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:36 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:36.713935 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-35bf07c6-ca4b-4b55-be0c-db4fbd6d5070 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:36.714686 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-35bf07c6-ca4b-4b55-be0c-db4fbd6d5070 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:36.721051 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35bf07c6-ca4b-4b55-be0c-db4fbd6d5070 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:36.721531 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35bf07c6-ca4b-4b55-be0c-db4fbd6d5070 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:36.721935 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35bf07c6-ca4b-4b55-be0c-db4fbd6d5070 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:36.722605 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35bf07c6-ca4b-4b55-be0c-db4fbd6d5070 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:36.723045 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35bf07c6-ca4b-4b55-be0c-db4fbd6d5070 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:36.723487 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35bf07c6-ca4b-4b55-be0c-db4fbd6d5070 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:36.857471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-35bf07c6-ca4b-4b55-be0c-db4fbd6d5070 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:36.865685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-35bf07c6-ca4b-4b55-be0c-db4fbd6d5070 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:36.867123 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-35bf07c6-ca4b-4b55-be0c-db4fbd6d5070 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:36.868234 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-35bf07c6-ca4b-4b55-be0c-db4fbd6d5070 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.159047 Aug 28 10:16:36.868826 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 75/147] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:36 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:37.507119 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ac0ede2a-0006-4ebc-af3f-95ed32c60173 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:37.507764 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ac0ede2a-0006-4ebc-af3f-95ed32c60173 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:37.514096 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-7a3da71d-afb8-42c3-ae62-62762fc137d7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:37.514096 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-7a3da71d-afb8-42c3-ae62-62762fc137d7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:37.514631 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ac0ede2a-0006-4ebc-af3f-95ed32c60173 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:37.515225 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ac0ede2a-0006-4ebc-af3f-95ed32c60173 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:37.515767 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ac0ede2a-0006-4ebc-af3f-95ed32c60173 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:37.516542 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ac0ede2a-0006-4ebc-af3f-95ed32c60173 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:37.517043 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ac0ede2a-0006-4ebc-af3f-95ed32c60173 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:37.517608 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ac0ede2a-0006-4ebc-af3f-95ed32c60173 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:37.519776 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7a3da71d-afb8-42c3-ae62-62762fc137d7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:37.520264 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7a3da71d-afb8-42c3-ae62-62762fc137d7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:37.520718 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7a3da71d-afb8-42c3-ae62-62762fc137d7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:37.521410 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7a3da71d-afb8-42c3-ae62-62762fc137d7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:37.521882 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7a3da71d-afb8-42c3-ae62-62762fc137d7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:37.522290 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7a3da71d-afb8-42c3-ae62-62762fc137d7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:37.727329 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ac0ede2a-0006-4ebc-af3f-95ed32c60173 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:37.730535 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7a3da71d-afb8-42c3-ae62-62762fc137d7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:37.735389 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ac0ede2a-0006-4ebc-af3f-95ed32c60173 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.232082 Aug 28 10:16:37.736052 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 76/148] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:37 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:37.738359 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-7a3da71d-afb8-42c3-ae62-62762fc137d7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.238448 Aug 28 10:16:37.738908 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 73/149] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:37 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:37.740722 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c6e14593-bffa-4c1c-b5e4-c5eddd1366e6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:37.741394 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c6e14593-bffa-4c1c-b5e4-c5eddd1366e6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:37.747104 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6e14593-bffa-4c1c-b5e4-c5eddd1366e6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:37.747708 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6e14593-bffa-4c1c-b5e4-c5eddd1366e6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:37.748199 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6e14593-bffa-4c1c-b5e4-c5eddd1366e6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:37.748969 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6e14593-bffa-4c1c-b5e4-c5eddd1366e6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:37.749479 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6e14593-bffa-4c1c-b5e4-c5eddd1366e6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:37.749961 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6e14593-bffa-4c1c-b5e4-c5eddd1366e6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:37.878360 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c6e14593-bffa-4c1c-b5e4-c5eddd1366e6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:37.886896 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c6e14593-bffa-4c1c-b5e4-c5eddd1366e6 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.149762 Aug 28 10:16:37.887464 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 77/150] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:37 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:37.890898 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-61601336-87e9-42a0-9ab7-7eb55b3c253e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:37.891491 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-61601336-87e9-42a0-9ab7-7eb55b3c253e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:37.897551 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61601336-87e9-42a0-9ab7-7eb55b3c253e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:37.898089 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61601336-87e9-42a0-9ab7-7eb55b3c253e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:37.898507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61601336-87e9-42a0-9ab7-7eb55b3c253e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:37.899164 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61601336-87e9-42a0-9ab7-7eb55b3c253e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:37.899597 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61601336-87e9-42a0-9ab7-7eb55b3c253e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:37.900001 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61601336-87e9-42a0-9ab7-7eb55b3c253e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:38.036140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-61601336-87e9-42a0-9ab7-7eb55b3c253e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:38.046569 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-61601336-87e9-42a0-9ab7-7eb55b3c253e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:38.048007 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-61601336-87e9-42a0-9ab7-7eb55b3c253e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:38.049143 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-61601336-87e9-42a0-9ab7-7eb55b3c253e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.162245 Aug 28 10:16:38.049696 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 74/151] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:37 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:38.755467 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1afc9aaf-8897-447e-879f-653b864b8ca0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:38.756058 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1afc9aaf-8897-447e-879f-653b864b8ca0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:38.758192 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8b7192e6-da03-4dfe-bec2-c12a5a11db3b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:38.758851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-8b7192e6-da03-4dfe-bec2-c12a5a11db3b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:38.763152 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1afc9aaf-8897-447e-879f-653b864b8ca0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:38.763623 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1afc9aaf-8897-447e-879f-653b864b8ca0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:38.764045 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1afc9aaf-8897-447e-879f-653b864b8ca0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:38.764743 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1afc9aaf-8897-447e-879f-653b864b8ca0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:38.765177 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1afc9aaf-8897-447e-879f-653b864b8ca0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:38.765581 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1afc9aaf-8897-447e-879f-653b864b8ca0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:38.770005 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8b7192e6-da03-4dfe-bec2-c12a5a11db3b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:38.770545 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8b7192e6-da03-4dfe-bec2-c12a5a11db3b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:38.771006 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8b7192e6-da03-4dfe-bec2-c12a5a11db3b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:38.771827 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8b7192e6-da03-4dfe-bec2-c12a5a11db3b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:38.772260 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8b7192e6-da03-4dfe-bec2-c12a5a11db3b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:38.772698 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8b7192e6-da03-4dfe-bec2-c12a5a11db3b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:38.997555 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8b7192e6-da03-4dfe-bec2-c12a5a11db3b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:38.998027 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1afc9aaf-8897-447e-879f-653b864b8ca0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:39.008263 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1afc9aaf-8897-447e-879f-653b864b8ca0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.256578 Aug 28 10:16:39.009208 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 78/152] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:38 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:39.010519 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-8b7192e6-da03-4dfe-bec2-c12a5a11db3b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.255772 Aug 28 10:16:39.011098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 75/153] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:38 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:16:39.015470 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-848a76a0-21f0-4b40-ae91-9059df116995 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:39.016061 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-848a76a0-21f0-4b40-ae91-9059df116995 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:39.022132 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-848a76a0-21f0-4b40-ae91-9059df116995 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:39.024985 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-848a76a0-21f0-4b40-ae91-9059df116995 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:39.025437 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-848a76a0-21f0-4b40-ae91-9059df116995 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:39.026284 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-848a76a0-21f0-4b40-ae91-9059df116995 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:39.027250 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-848a76a0-21f0-4b40-ae91-9059df116995 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:39.027926 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-848a76a0-21f0-4b40-ae91-9059df116995 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:39.074301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-82721137-6709-40a9-a3d0-6d0f7592deef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:39.076830 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-82721137-6709-40a9-a3d0-6d0f7592deef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:39.098121 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-82721137-6709-40a9-a3d0-6d0f7592deef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:39.105221 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-82721137-6709-40a9-a3d0-6d0f7592deef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:39.105776 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-82721137-6709-40a9-a3d0-6d0f7592deef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:39.106920 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-82721137-6709-40a9-a3d0-6d0f7592deef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:39.107710 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-82721137-6709-40a9-a3d0-6d0f7592deef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:39.108229 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-82721137-6709-40a9-a3d0-6d0f7592deef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:39.510163 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-848a76a0-21f0-4b40-ae91-9059df116995 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:39.520630 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-848a76a0-21f0-4b40-ae91-9059df116995 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.509943 Aug 28 10:16:39.521208 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 79/154] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:39 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:39.532437 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-82721137-6709-40a9-a3d0-6d0f7592deef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:39.540874 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-82721137-6709-40a9-a3d0-6d0f7592deef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:39.542295 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-82721137-6709-40a9-a3d0-6d0f7592deef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:39.543712 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-82721137-6709-40a9-a3d0-6d0f7592deef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.475378 Aug 28 10:16:39.544267 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 76/155] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:39 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 28 10:16:40.043299 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-051ba9c4-aa8f-4c54-b656-12664504d821 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:40.044304 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-051ba9c4-aa8f-4c54-b656-12664504d821 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:40.047208 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:40.049194 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-0e91d4fe-e1c1-436c-8d33-480cc56e2615 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:40.050222 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-0e91d4fe-e1c1-436c-8d33-480cc56e2615 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:40.055304 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-051ba9c4-aa8f-4c54-b656-12664504d821 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:40.055781 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-051ba9c4-aa8f-4c54-b656-12664504d821 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:40.056222 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-051ba9c4-aa8f-4c54-b656-12664504d821 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:40.056931 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-051ba9c4-aa8f-4c54-b656-12664504d821 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:40.057339 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-051ba9c4-aa8f-4c54-b656-12664504d821 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:40.057745 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-051ba9c4-aa8f-4c54-b656-12664504d821 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:40.057891 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0e91d4fe-e1c1-436c-8d33-480cc56e2615 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:40.058232 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0e91d4fe-e1c1-436c-8d33-480cc56e2615 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:40.058651 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0e91d4fe-e1c1-436c-8d33-480cc56e2615 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:40.059350 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0e91d4fe-e1c1-436c-8d33-480cc56e2615 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:40.059791 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0e91d4fe-e1c1-436c-8d33-480cc56e2615 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:40.060192 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0e91d4fe-e1c1-436c-8d33-480cc56e2615 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:40.252009 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-0e91d4fe-e1c1-436c-8d33-480cc56e2615 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:40.255211 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-051ba9c4-aa8f-4c54-b656-12664504d821 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:40.259769 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-0e91d4fe-e1c1-436c-8d33-480cc56e2615 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.217119 Aug 28 10:16:40.260457 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 77/156] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:40 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:40.263327 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-051ba9c4-aa8f-4c54-b656-12664504d821 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.226761 Aug 28 10:16:40.263885 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 80/157] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:40 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:40.542598 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-38c6859a-9a43-4fde-970f-4c716cf2e846 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:40.543445 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-38c6859a-9a43-4fde-970f-4c716cf2e846 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:40.545674 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=95 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:40.550764 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-38c6859a-9a43-4fde-970f-4c716cf2e846 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:40.551245 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-38c6859a-9a43-4fde-970f-4c716cf2e846 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:40.551664 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-38c6859a-9a43-4fde-970f-4c716cf2e846 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:40.552372 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-38c6859a-9a43-4fde-970f-4c716cf2e846 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:40.552843 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-38c6859a-9a43-4fde-970f-4c716cf2e846 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:40.553257 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-38c6859a-9a43-4fde-970f-4c716cf2e846 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:40.566361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ddbbd29c-1403-4cc4-a675-7656d20cc816 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:40.566951 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ddbbd29c-1403-4cc4-a675-7656d20cc816 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:40.573027 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ddbbd29c-1403-4cc4-a675-7656d20cc816 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:40.573474 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ddbbd29c-1403-4cc4-a675-7656d20cc816 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:40.573902 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ddbbd29c-1403-4cc4-a675-7656d20cc816 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:40.574569 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ddbbd29c-1403-4cc4-a675-7656d20cc816 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:40.574998 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ddbbd29c-1403-4cc4-a675-7656d20cc816 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:40.575400 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ddbbd29c-1403-4cc4-a675-7656d20cc816 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:40.751322 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-38c6859a-9a43-4fde-970f-4c716cf2e846 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:40.755518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ddbbd29c-1403-4cc4-a675-7656d20cc816 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:40.759949 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-38c6859a-9a43-4fde-970f-4c716cf2e846 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.222008 Aug 28 10:16:40.760643 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 78/158] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:40 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:40.763721 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ddbbd29c-1403-4cc4-a675-7656d20cc816 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:40.765249 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ddbbd29c-1403-4cc4-a675-7656d20cc816 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:40.766334 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ddbbd29c-1403-4cc4-a675-7656d20cc816 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.203857 Aug 28 10:16:40.766876 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 81/159] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:40 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:41.280889 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-6d8a0554-ea95-4a8d-b6cf-670bc04e10c6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:41.281490 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-6d8a0554-ea95-4a8d-b6cf-670bc04e10c6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:41.283106 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-19e22b61-ad85-444e-8b5f-4069074d4e32 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:41.283708 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-19e22b61-ad85-444e-8b5f-4069074d4e32 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:41.288198 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6d8a0554-ea95-4a8d-b6cf-670bc04e10c6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:41.289109 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6d8a0554-ea95-4a8d-b6cf-670bc04e10c6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:41.289542 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6d8a0554-ea95-4a8d-b6cf-670bc04e10c6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:41.290077 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-19e22b61-ad85-444e-8b5f-4069074d4e32 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:41.290236 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6d8a0554-ea95-4a8d-b6cf-670bc04e10c6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:41.290543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-19e22b61-ad85-444e-8b5f-4069074d4e32 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:41.290676 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6d8a0554-ea95-4a8d-b6cf-670bc04e10c6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:41.290941 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-19e22b61-ad85-444e-8b5f-4069074d4e32 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:41.291034 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6d8a0554-ea95-4a8d-b6cf-670bc04e10c6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:41.291607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-19e22b61-ad85-444e-8b5f-4069074d4e32 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:41.292040 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-19e22b61-ad85-444e-8b5f-4069074d4e32 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:41.292440 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-19e22b61-ad85-444e-8b5f-4069074d4e32 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:41.482340 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-6d8a0554-ea95-4a8d-b6cf-670bc04e10c6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:41.487518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-19e22b61-ad85-444e-8b5f-4069074d4e32 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:41.490182 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-6d8a0554-ea95-4a8d-b6cf-670bc04e10c6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.213475 Aug 28 10:16:41.490812 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 79/160] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:41 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:41.495321 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-19e22b61-ad85-444e-8b5f-4069074d4e32 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.216070 Aug 28 10:16:41.495890 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 82/161] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:41 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:16:41.786805 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4c3f1559-a700-4fa7-aa5e-fcb06e428afb tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:41.787640 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4c3f1559-a700-4fa7-aa5e-fcb06e428afb tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:41.793259 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2c38ba14-c727-4a6c-b955-c5828f9c688b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:41.794236 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2c38ba14-c727-4a6c-b955-c5828f9c688b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:41.798218 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4c3f1559-a700-4fa7-aa5e-fcb06e428afb tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:41.799015 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4c3f1559-a700-4fa7-aa5e-fcb06e428afb tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:41.799693 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4c3f1559-a700-4fa7-aa5e-fcb06e428afb tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:41.800883 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4c3f1559-a700-4fa7-aa5e-fcb06e428afb tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:41.801858 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4c3f1559-a700-4fa7-aa5e-fcb06e428afb tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:41.802671 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4c3f1559-a700-4fa7-aa5e-fcb06e428afb tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:41.803779 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c38ba14-c727-4a6c-b955-c5828f9c688b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:41.804550 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c38ba14-c727-4a6c-b955-c5828f9c688b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:41.805257 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c38ba14-c727-4a6c-b955-c5828f9c688b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:41.806353 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c38ba14-c727-4a6c-b955-c5828f9c688b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:41.806794 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c38ba14-c727-4a6c-b955-c5828f9c688b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:41.807195 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c38ba14-c727-4a6c-b955-c5828f9c688b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:41.994211 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4c3f1559-a700-4fa7-aa5e-fcb06e428afb tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:41.997435 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2c38ba14-c727-4a6c-b955-c5828f9c688b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:41.997786 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=100 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:42.003132 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4c3f1559-a700-4fa7-aa5e-fcb06e428afb tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.223096 Aug 28 10:16:42.003714 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 80/162] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:41 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:42.006133 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2c38ba14-c727-4a6c-b955-c5828f9c688b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:42.007573 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2c38ba14-c727-4a6c-b955-c5828f9c688b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:42.008720 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2c38ba14-c727-4a6c-b955-c5828f9c688b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.222803 Aug 28 10:16:42.009354 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 83/163] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:41 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:42.514935 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-5a57ba04-c8de-4b24-a654-83417c36a645 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:42.515880 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-5a57ba04-c8de-4b24-a654-83417c36a645 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:42.518651 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a4b6d176-7485-442f-87c1-e95ae1dc44cf tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:42.519438 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=2 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:42.519613 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a4b6d176-7485-442f-87c1-e95ae1dc44cf tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:42.527324 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5a57ba04-c8de-4b24-a654-83417c36a645 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:42.527826 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5a57ba04-c8de-4b24-a654-83417c36a645 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:42.527970 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4b6d176-7485-442f-87c1-e95ae1dc44cf tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:42.528247 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5a57ba04-c8de-4b24-a654-83417c36a645 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:42.528428 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4b6d176-7485-442f-87c1-e95ae1dc44cf tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:42.528745 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4b6d176-7485-442f-87c1-e95ae1dc44cf tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:42.528971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5a57ba04-c8de-4b24-a654-83417c36a645 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:42.529411 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5a57ba04-c8de-4b24-a654-83417c36a645 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:42.529550 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4b6d176-7485-442f-87c1-e95ae1dc44cf tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:42.529824 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5a57ba04-c8de-4b24-a654-83417c36a645 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:42.530003 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4b6d176-7485-442f-87c1-e95ae1dc44cf tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:42.530258 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4b6d176-7485-442f-87c1-e95ae1dc44cf tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:42.549214 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:42.719914 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-5a57ba04-c8de-4b24-a654-83417c36a645 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:42.723008 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a4b6d176-7485-442f-87c1-e95ae1dc44cf tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:42.727855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-5a57ba04-c8de-4b24-a654-83417c36a645 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.219615 Aug 28 10:16:42.728464 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 81/164] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:42 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:42.731181 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a4b6d176-7485-442f-87c1-e95ae1dc44cf tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.218782 Aug 28 10:16:42.731758 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 84/165] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:42 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:16:43.023662 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-fd570680-bbc9-4922-bcbe-c42b8a7fcf16 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:43.024284 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-fd570680-bbc9-4922-bcbe-c42b8a7fcf16 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:43.030621 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fd570680-bbc9-4922-bcbe-c42b8a7fcf16 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:43.031089 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bd01c867-eedb-44a5-8951-3065ca296877 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:43.031227 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fd570680-bbc9-4922-bcbe-c42b8a7fcf16 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:43.031503 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fd570680-bbc9-4922-bcbe-c42b8a7fcf16 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:43.031677 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bd01c867-eedb-44a5-8951-3065ca296877 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:43.032177 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fd570680-bbc9-4922-bcbe-c42b8a7fcf16 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:43.032625 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fd570680-bbc9-4922-bcbe-c42b8a7fcf16 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:43.033057 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fd570680-bbc9-4922-bcbe-c42b8a7fcf16 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:43.043756 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd01c867-eedb-44a5-8951-3065ca296877 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:43.044233 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd01c867-eedb-44a5-8951-3065ca296877 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:43.044698 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd01c867-eedb-44a5-8951-3065ca296877 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:43.045446 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd01c867-eedb-44a5-8951-3065ca296877 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:43.045885 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd01c867-eedb-44a5-8951-3065ca296877 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:43.046295 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd01c867-eedb-44a5-8951-3065ca296877 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:43.229179 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-fd570680-bbc9-4922-bcbe-c42b8a7fcf16 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:43.233774 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bd01c867-eedb-44a5-8951-3065ca296877 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:43.237458 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-fd570680-bbc9-4922-bcbe-c42b8a7fcf16 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.217578 Aug 28 10:16:43.238006 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 82/166] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:43 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:43.242128 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bd01c867-eedb-44a5-8951-3065ca296877 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:43.243627 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bd01c867-eedb-44a5-8951-3065ca296877 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:43.244761 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bd01c867-eedb-44a5-8951-3065ca296877 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.217561 Aug 28 10:16:43.245449 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 85/167] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:43 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:43.748666 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8d4e404d-ab31-4383-9255-6bc0e746a018 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:43.749187 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-8d4e404d-ab31-4383-9255-6bc0e746a018 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:43.751779 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-afe345a8-7049-40a1-b0d4-72eb4092cfa1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:43.752424 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-afe345a8-7049-40a1-b0d4-72eb4092cfa1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:43.756241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8d4e404d-ab31-4383-9255-6bc0e746a018 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:43.756936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8d4e404d-ab31-4383-9255-6bc0e746a018 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:43.757517 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8d4e404d-ab31-4383-9255-6bc0e746a018 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:43.758273 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8d4e404d-ab31-4383-9255-6bc0e746a018 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:43.758570 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-afe345a8-7049-40a1-b0d4-72eb4092cfa1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:43.758716 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8d4e404d-ab31-4383-9255-6bc0e746a018 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:43.759050 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-afe345a8-7049-40a1-b0d4-72eb4092cfa1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:43.759143 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8d4e404d-ab31-4383-9255-6bc0e746a018 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:43.759473 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-afe345a8-7049-40a1-b0d4-72eb4092cfa1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:43.760180 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-afe345a8-7049-40a1-b0d4-72eb4092cfa1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:43.760647 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-afe345a8-7049-40a1-b0d4-72eb4092cfa1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:43.761047 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-afe345a8-7049-40a1-b0d4-72eb4092cfa1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:43.960107 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8d4e404d-ab31-4383-9255-6bc0e746a018 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:43.963347 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-afe345a8-7049-40a1-b0d4-72eb4092cfa1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:43.971435 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-afe345a8-7049-40a1-b0d4-72eb4092cfa1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.224127 Aug 28 10:16:43.972549 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 86/168] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:43 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:16:43.979226 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-8d4e404d-ab31-4383-9255-6bc0e746a018 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.234469 Aug 28 10:16:43.979874 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 83/169] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:43 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:44.261749 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cd392196-1dcc-476c-b6e3-60a26479f100 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:44.262367 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cd392196-1dcc-476c-b6e3-60a26479f100 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:44.267839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c5b309ff-0e15-4018-83a2-1673b9ab61ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:44.268521 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c5b309ff-0e15-4018-83a2-1673b9ab61ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:44.269375 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cd392196-1dcc-476c-b6e3-60a26479f100 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:44.269904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cd392196-1dcc-476c-b6e3-60a26479f100 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:44.270582 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cd392196-1dcc-476c-b6e3-60a26479f100 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:44.271313 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cd392196-1dcc-476c-b6e3-60a26479f100 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:44.271842 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cd392196-1dcc-476c-b6e3-60a26479f100 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:44.272297 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cd392196-1dcc-476c-b6e3-60a26479f100 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:44.275249 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c5b309ff-0e15-4018-83a2-1673b9ab61ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:44.275768 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c5b309ff-0e15-4018-83a2-1673b9ab61ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:44.276229 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c5b309ff-0e15-4018-83a2-1673b9ab61ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:44.277095 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c5b309ff-0e15-4018-83a2-1673b9ab61ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:44.277583 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c5b309ff-0e15-4018-83a2-1673b9ab61ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:44.278036 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c5b309ff-0e15-4018-83a2-1673b9ab61ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:44.471875 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cd392196-1dcc-476c-b6e3-60a26479f100 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:44.479105 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c5b309ff-0e15-4018-83a2-1673b9ab61ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:44.479767 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cd392196-1dcc-476c-b6e3-60a26479f100 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.224519 Aug 28 10:16:44.480387 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 87/170] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:44 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:44.487491 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c5b309ff-0e15-4018-83a2-1673b9ab61ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:44.488941 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c5b309ff-0e15-4018-83a2-1673b9ab61ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:44.490013 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c5b309ff-0e15-4018-83a2-1673b9ab61ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.226542 Aug 28 10:16:44.490554 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 84/171] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:44 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:44.996129 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cf65837f-0d8a-439f-918e-2ca9d686b6e9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:44.997116 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cf65837f-0d8a-439f-918e-2ca9d686b6e9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:45.000038 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=99 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:45.003322 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-105ec84b-fb26-4100-a1f3-07ff3ae4733a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:45.004320 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-105ec84b-fb26-4100-a1f3-07ff3ae4733a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:45.009717 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cf65837f-0d8a-439f-918e-2ca9d686b6e9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:45.010501 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cf65837f-0d8a-439f-918e-2ca9d686b6e9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:45.011262 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cf65837f-0d8a-439f-918e-2ca9d686b6e9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:45.011947 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cf65837f-0d8a-439f-918e-2ca9d686b6e9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:45.012385 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cf65837f-0d8a-439f-918e-2ca9d686b6e9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:45.012844 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cf65837f-0d8a-439f-918e-2ca9d686b6e9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:45.013015 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-105ec84b-fb26-4100-a1f3-07ff3ae4733a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:45.013502 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-105ec84b-fb26-4100-a1f3-07ff3ae4733a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:45.014004 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-105ec84b-fb26-4100-a1f3-07ff3ae4733a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:45.014691 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-105ec84b-fb26-4100-a1f3-07ff3ae4733a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:45.015131 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-105ec84b-fb26-4100-a1f3-07ff3ae4733a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:45.015540 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-105ec84b-fb26-4100-a1f3-07ff3ae4733a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:45.214704 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cf65837f-0d8a-439f-918e-2ca9d686b6e9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:45.223628 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-105ec84b-fb26-4100-a1f3-07ff3ae4733a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:45.226958 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cf65837f-0d8a-439f-918e-2ca9d686b6e9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.237276 Aug 28 10:16:45.230890 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 88/172] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:44 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:45.233712 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-105ec84b-fb26-4100-a1f3-07ff3ae4733a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.237018 Aug 28 10:16:45.234463 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 85/173] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:44 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:45.500925 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bf7ffae6-21da-4ed0-a08b-b78647ad7899 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:45.501530 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bf7ffae6-21da-4ed0-a08b-b78647ad7899 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:45.508637 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bf7ffae6-21da-4ed0-a08b-b78647ad7899 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:45.509422 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bf7ffae6-21da-4ed0-a08b-b78647ad7899 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:45.510028 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bf7ffae6-21da-4ed0-a08b-b78647ad7899 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:45.510868 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bf7ffae6-21da-4ed0-a08b-b78647ad7899 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:45.511270 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-84053ddc-302b-4f37-aa10-cdeb546a19b7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:45.511467 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bf7ffae6-21da-4ed0-a08b-b78647ad7899 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:45.511864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-84053ddc-302b-4f37-aa10-cdeb546a19b7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:45.511978 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bf7ffae6-21da-4ed0-a08b-b78647ad7899 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:45.518125 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-84053ddc-302b-4f37-aa10-cdeb546a19b7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:45.518595 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-84053ddc-302b-4f37-aa10-cdeb546a19b7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:45.519009 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-84053ddc-302b-4f37-aa10-cdeb546a19b7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:45.519705 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-84053ddc-302b-4f37-aa10-cdeb546a19b7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:45.520115 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-84053ddc-302b-4f37-aa10-cdeb546a19b7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:45.520537 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-84053ddc-302b-4f37-aa10-cdeb546a19b7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:45.724414 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bf7ffae6-21da-4ed0-a08b-b78647ad7899 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:45.731890 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-84053ddc-302b-4f37-aa10-cdeb546a19b7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:45.732409 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bf7ffae6-21da-4ed0-a08b-b78647ad7899 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.235471 Aug 28 10:16:45.733081 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 89/174] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:45 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:45.741315 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-84053ddc-302b-4f37-aa10-cdeb546a19b7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:45.742748 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-84053ddc-302b-4f37-aa10-cdeb546a19b7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:45.743995 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-84053ddc-302b-4f37-aa10-cdeb546a19b7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.236669 Aug 28 10:16:45.744560 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 86/175] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:45 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 28 10:16:46.202199 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-cb808cba-ee08-4a6f-a514-9889810571e9 req-60558ff8-ec0e-459e-8259-118ec9769771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4", "name": "network-vif-plugged", "status": "completed", "tag": "a3a7c610-6f76-4e40-86da-4aaffb9925dd"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:16:46.211746 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-cb808cba-ee08-4a6f-a514-9889810571e9 req-60558ff8-ec0e-459e-8259-118ec9769771 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:46.212202 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-cb808cba-ee08-4a6f-a514-9889810571e9 req-60558ff8-ec0e-459e-8259-118ec9769771 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:46.212652 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-cb808cba-ee08-4a6f-a514-9889810571e9 req-60558ff8-ec0e-459e-8259-118ec9769771 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:46.223888 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-cb808cba-ee08-4a6f-a514-9889810571e9 req-60558ff8-ec0e-459e-8259-118ec9769771 service nova] Creating event network-vif-plugged:a3a7c610-6f76-4e40-86da-4aaffb9925dd for instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 on hv-cinder-85200 Aug 28 10:16:46.229332 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-cb808cba-ee08-4a6f-a514-9889810571e9 req-60558ff8-ec0e-459e-8259-118ec9769771 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085434 Aug 28 10:16:46.230131 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 90/176] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:16:46.247796 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-d9c43b36-6173-47a1-a059-e59ab56fcd13 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:46.250332 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-d9c43b36-6173-47a1-a059-e59ab56fcd13 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:46.255449 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-56ce6ce3-58a7-4cbf-a150-10ecfd493ac6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:46.256044 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-56ce6ce3-58a7-4cbf-a150-10ecfd493ac6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:46.257530 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d9c43b36-6173-47a1-a059-e59ab56fcd13 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:46.258230 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d9c43b36-6173-47a1-a059-e59ab56fcd13 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:46.258701 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d9c43b36-6173-47a1-a059-e59ab56fcd13 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:46.259719 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d9c43b36-6173-47a1-a059-e59ab56fcd13 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:46.260223 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d9c43b36-6173-47a1-a059-e59ab56fcd13 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:46.260683 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d9c43b36-6173-47a1-a059-e59ab56fcd13 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:46.262786 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-56ce6ce3-58a7-4cbf-a150-10ecfd493ac6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:46.263267 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-56ce6ce3-58a7-4cbf-a150-10ecfd493ac6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:46.263699 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-56ce6ce3-58a7-4cbf-a150-10ecfd493ac6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:46.264382 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-56ce6ce3-58a7-4cbf-a150-10ecfd493ac6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:46.264866 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-56ce6ce3-58a7-4cbf-a150-10ecfd493ac6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:46.265283 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-56ce6ce3-58a7-4cbf-a150-10ecfd493ac6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:46.497958 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d9c43b36-6173-47a1-a059-e59ab56fcd13 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:46.501031 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-56ce6ce3-58a7-4cbf-a150-10ecfd493ac6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:46.505743 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-d9c43b36-6173-47a1-a059-e59ab56fcd13 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.262105 Aug 28 10:16:46.506516 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 87/177] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:46 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:46.509030 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-56ce6ce3-58a7-4cbf-a150-10ecfd493ac6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.257793 Aug 28 10:16:46.509587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 91/178] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:46 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:16:46.754654 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-05c4b787-f5ae-4385-a54b-1409a9b9f727 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:46.755265 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-05c4b787-f5ae-4385-a54b-1409a9b9f727 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:46.761845 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-05c4b787-f5ae-4385-a54b-1409a9b9f727 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:46.767025 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f81d80c7-df2b-4e8d-84ba-7acb6e50d194 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:46.768241 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f81d80c7-df2b-4e8d-84ba-7acb6e50d194 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:46.771599 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-05c4b787-f5ae-4385-a54b-1409a9b9f727 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:46.772030 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-05c4b787-f5ae-4385-a54b-1409a9b9f727 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:46.772814 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-05c4b787-f5ae-4385-a54b-1409a9b9f727 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:46.773232 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-05c4b787-f5ae-4385-a54b-1409a9b9f727 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:46.773648 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-05c4b787-f5ae-4385-a54b-1409a9b9f727 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:46.781192 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f81d80c7-df2b-4e8d-84ba-7acb6e50d194 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:46.781915 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f81d80c7-df2b-4e8d-84ba-7acb6e50d194 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:46.782583 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f81d80c7-df2b-4e8d-84ba-7acb6e50d194 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:46.783475 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f81d80c7-df2b-4e8d-84ba-7acb6e50d194 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:46.784118 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f81d80c7-df2b-4e8d-84ba-7acb6e50d194 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:46.784763 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f81d80c7-df2b-4e8d-84ba-7acb6e50d194 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:46.991647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-05c4b787-f5ae-4385-a54b-1409a9b9f727 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:46.996610 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f81d80c7-df2b-4e8d-84ba-7acb6e50d194 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:47.001375 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-05c4b787-f5ae-4385-a54b-1409a9b9f727 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.252305 Aug 28 10:16:47.002136 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 88/179] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:46 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:47.006192 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f81d80c7-df2b-4e8d-84ba-7acb6e50d194 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:47.007946 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f81d80c7-df2b-4e8d-84ba-7acb6e50d194 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:47.009506 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f81d80c7-df2b-4e8d-84ba-7acb6e50d194 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.246273 Aug 28 10:16:47.010176 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 92/180] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:46 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:47.528326 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-af062e98-596c-4ef3-9d05-a461ebea2897 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:47.529577 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-af062e98-596c-4ef3-9d05-a461ebea2897 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:47.531121 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5fa26147-db15-4194-8248-3f6bb11ad482 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:47.531856 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5fa26147-db15-4194-8248-3f6bb11ad482 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:47.537424 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-af062e98-596c-4ef3-9d05-a461ebea2897 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:47.538100 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-af062e98-596c-4ef3-9d05-a461ebea2897 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:47.539826 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5fa26147-db15-4194-8248-3f6bb11ad482 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:47.540200 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-af062e98-596c-4ef3-9d05-a461ebea2897 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:47.540463 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5fa26147-db15-4194-8248-3f6bb11ad482 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:47.540902 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5fa26147-db15-4194-8248-3f6bb11ad482 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:47.541593 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5fa26147-db15-4194-8248-3f6bb11ad482 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:47.542373 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-af062e98-596c-4ef3-9d05-a461ebea2897 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:47.542883 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5fa26147-db15-4194-8248-3f6bb11ad482 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:47.543023 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-af062e98-596c-4ef3-9d05-a461ebea2897 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:47.543433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-af062e98-596c-4ef3-9d05-a461ebea2897 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:47.543697 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5fa26147-db15-4194-8248-3f6bb11ad482 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:47.754669 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-af062e98-596c-4ef3-9d05-a461ebea2897 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:47.761400 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5fa26147-db15-4194-8248-3f6bb11ad482 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:47.767781 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-af062e98-596c-4ef3-9d05-a461ebea2897 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.243578 Aug 28 10:16:47.768390 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 89/181] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:47 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:47.771251 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5fa26147-db15-4194-8248-3f6bb11ad482 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.245308 Aug 28 10:16:47.772066 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 93/182] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:47 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:48.023179 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-205a17ec-5d9f-415c-9187-ea54d8eec673 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:48.024022 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-205a17ec-5d9f-415c-9187-ea54d8eec673 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:48.034223 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-205a17ec-5d9f-415c-9187-ea54d8eec673 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:48.034699 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0cfdc8cc-b043-433f-82dc-851051f30f3e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:48.035307 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0cfdc8cc-b043-433f-82dc-851051f30f3e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:48.035986 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-205a17ec-5d9f-415c-9187-ea54d8eec673 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:48.036419 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-205a17ec-5d9f-415c-9187-ea54d8eec673 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:48.037310 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-205a17ec-5d9f-415c-9187-ea54d8eec673 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:48.044118 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0cfdc8cc-b043-433f-82dc-851051f30f3e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:48.044941 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0cfdc8cc-b043-433f-82dc-851051f30f3e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:48.045541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-205a17ec-5d9f-415c-9187-ea54d8eec673 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:48.046169 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-205a17ec-5d9f-415c-9187-ea54d8eec673 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:48.048070 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0cfdc8cc-b043-433f-82dc-851051f30f3e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:48.049191 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0cfdc8cc-b043-433f-82dc-851051f30f3e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:48.049804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0cfdc8cc-b043-433f-82dc-851051f30f3e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:48.050230 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0cfdc8cc-b043-433f-82dc-851051f30f3e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:48.345727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-205a17ec-5d9f-415c-9187-ea54d8eec673 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:48.359139 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-205a17ec-5d9f-415c-9187-ea54d8eec673 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.340598 Aug 28 10:16:48.360126 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 90/183] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:48 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:48.398829 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0cfdc8cc-b043-433f-82dc-851051f30f3e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:48.407510 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0cfdc8cc-b043-433f-82dc-851051f30f3e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:48.408966 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0cfdc8cc-b043-433f-82dc-851051f30f3e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:48.410063 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0cfdc8cc-b043-433f-82dc-851051f30f3e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.381616 Aug 28 10:16:48.414808 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 94/184] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:48 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 28 10:16:48.810727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-44efe081-cc1b-487f-af9c-314960605443 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:48.811291 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e36fd8c2-6c28-4c69-8ec2-55b6a795fad7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:48.812667 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-44efe081-cc1b-487f-af9c-314960605443 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:48.812992 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e36fd8c2-6c28-4c69-8ec2-55b6a795fad7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:48.839536 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e36fd8c2-6c28-4c69-8ec2-55b6a795fad7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:48.842020 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e36fd8c2-6c28-4c69-8ec2-55b6a795fad7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:48.842468 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e36fd8c2-6c28-4c69-8ec2-55b6a795fad7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:48.844951 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-44efe081-cc1b-487f-af9c-314960605443 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:48.845511 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-44efe081-cc1b-487f-af9c-314960605443 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:48.847021 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-44efe081-cc1b-487f-af9c-314960605443 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:48.848347 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e36fd8c2-6c28-4c69-8ec2-55b6a795fad7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:48.850871 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e36fd8c2-6c28-4c69-8ec2-55b6a795fad7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:48.852411 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-44efe081-cc1b-487f-af9c-314960605443 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:48.852928 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-44efe081-cc1b-487f-af9c-314960605443 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:48.854531 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e36fd8c2-6c28-4c69-8ec2-55b6a795fad7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:48.856749 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-44efe081-cc1b-487f-af9c-314960605443 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:49.139626 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-44efe081-cc1b-487f-af9c-314960605443 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:49.150035 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-44efe081-cc1b-487f-af9c-314960605443 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.352020 Aug 28 10:16:49.151293 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 91/185] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:48 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:49.193372 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e36fd8c2-6c28-4c69-8ec2-55b6a795fad7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:49.207949 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e36fd8c2-6c28-4c69-8ec2-55b6a795fad7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.406127 Aug 28 10:16:49.209814 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 95/186] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:48 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:49.379858 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-3789c375-a673-4807-8c9c-4dea1b6c3d9c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:49.380766 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-3789c375-a673-4807-8c9c-4dea1b6c3d9c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:49.392790 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3789c375-a673-4807-8c9c-4dea1b6c3d9c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:49.395200 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3789c375-a673-4807-8c9c-4dea1b6c3d9c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:49.396867 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3789c375-a673-4807-8c9c-4dea1b6c3d9c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:49.398641 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3789c375-a673-4807-8c9c-4dea1b6c3d9c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:49.400188 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3789c375-a673-4807-8c9c-4dea1b6c3d9c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:49.402012 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3789c375-a673-4807-8c9c-4dea1b6c3d9c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:49.440231 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c7c85e2d-19fa-41c9-8bd3-c0b2933ce7ba tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:49.442089 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c7c85e2d-19fa-41c9-8bd3-c0b2933ce7ba tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:49.460444 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c7c85e2d-19fa-41c9-8bd3-c0b2933ce7ba tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:49.462369 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c7c85e2d-19fa-41c9-8bd3-c0b2933ce7ba tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:49.464101 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c7c85e2d-19fa-41c9-8bd3-c0b2933ce7ba tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:49.464950 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c7c85e2d-19fa-41c9-8bd3-c0b2933ce7ba tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:49.473228 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c7c85e2d-19fa-41c9-8bd3-c0b2933ce7ba tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:49.474486 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c7c85e2d-19fa-41c9-8bd3-c0b2933ce7ba tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:49.873007 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-3789c375-a673-4807-8c9c-4dea1b6c3d9c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:49.883843 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-3789c375-a673-4807-8c9c-4dea1b6c3d9c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.506582 Aug 28 10:16:49.898516 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 92/187] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:49 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:49.907339 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c7c85e2d-19fa-41c9-8bd3-c0b2933ce7ba tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:49.917998 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c7c85e2d-19fa-41c9-8bd3-c0b2933ce7ba tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:49.919438 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c7c85e2d-19fa-41c9-8bd3-c0b2933ce7ba tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:49.920570 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c7c85e2d-19fa-41c9-8bd3-c0b2933ce7ba tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.484990 Aug 28 10:16:49.932847 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 96/188] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:49 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:50.172445 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-5f96467a-c835-40db-b444-9a5c39c4b73d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:50.173423 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-5f96467a-c835-40db-b444-9a5c39c4b73d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:50.184128 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5f96467a-c835-40db-b444-9a5c39c4b73d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:50.184881 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5f96467a-c835-40db-b444-9a5c39c4b73d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:50.185556 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5f96467a-c835-40db-b444-9a5c39c4b73d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:50.187759 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5f96467a-c835-40db-b444-9a5c39c4b73d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:50.188381 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5f96467a-c835-40db-b444-9a5c39c4b73d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:50.191120 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5f96467a-c835-40db-b444-9a5c39c4b73d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:50.230348 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-86b93ded-04f6-49fd-a220-1b7d9dbb8329 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:50.231295 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-86b93ded-04f6-49fd-a220-1b7d9dbb8329 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:50.240085 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86b93ded-04f6-49fd-a220-1b7d9dbb8329 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:50.240618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86b93ded-04f6-49fd-a220-1b7d9dbb8329 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:50.246071 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86b93ded-04f6-49fd-a220-1b7d9dbb8329 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:50.246834 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86b93ded-04f6-49fd-a220-1b7d9dbb8329 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:50.247477 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86b93ded-04f6-49fd-a220-1b7d9dbb8329 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:50.248047 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86b93ded-04f6-49fd-a220-1b7d9dbb8329 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:50.552235 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-5f96467a-c835-40db-b444-9a5c39c4b73d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:50.562229 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-5f96467a-c835-40db-b444-9a5c39c4b73d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.393063 Aug 28 10:16:50.563699 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 93/189] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:50 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:50.583298 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-b9e2a04f-9234-4a14-aa53-3901bc8a7b16 req-fdc33733-9de3-404a-b263-7c75c717b7aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c41bc126-2936-43a3-a819-e9433bb7f8f4", "name": "network-vif-plugged", "status": "completed", "tag": "f3149d41-a93c-4c32-b02d-c9686354c16c"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:16:50.594426 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-b9e2a04f-9234-4a14-aa53-3901bc8a7b16 req-fdc33733-9de3-404a-b263-7c75c717b7aa service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:50.594988 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-b9e2a04f-9234-4a14-aa53-3901bc8a7b16 req-fdc33733-9de3-404a-b263-7c75c717b7aa service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:50.595448 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-b9e2a04f-9234-4a14-aa53-3901bc8a7b16 req-fdc33733-9de3-404a-b263-7c75c717b7aa service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:50.609264 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-b9e2a04f-9234-4a14-aa53-3901bc8a7b16 req-fdc33733-9de3-404a-b263-7c75c717b7aa service nova] Creating event network-vif-plugged:f3149d41-a93c-4c32-b02d-c9686354c16c for instance c41bc126-2936-43a3-a819-e9433bb7f8f4 on hv-cinder-85200 Aug 28 10:16:50.614479 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-86b93ded-04f6-49fd-a220-1b7d9dbb8329 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:50.614736 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-b9e2a04f-9234-4a14-aa53-3901bc8a7b16 req-fdc33733-9de3-404a-b263-7c75c717b7aa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049538 Aug 28 10:16:50.615550 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 94/190] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:16:50.624857 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-86b93ded-04f6-49fd-a220-1b7d9dbb8329 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.397957 Aug 28 10:16:50.636533 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 97/191] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:50 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:50.907279 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-14919d69-035f-4162-a68d-310373f4b1ef tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:50.908770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-14919d69-035f-4162-a68d-310373f4b1ef tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:50.924220 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-14919d69-035f-4162-a68d-310373f4b1ef tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:50.936316 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-14919d69-035f-4162-a68d-310373f4b1ef tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:50.936859 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-14919d69-035f-4162-a68d-310373f4b1ef tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:50.937612 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-14919d69-035f-4162-a68d-310373f4b1ef tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:50.945063 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e17e9db3-2618-4ac0-bf64-2d91799532df tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:50.946091 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e17e9db3-2618-4ac0-bf64-2d91799532df tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:50.953047 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-14919d69-035f-4162-a68d-310373f4b1ef tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:50.953645 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-14919d69-035f-4162-a68d-310373f4b1ef tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:50.962866 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e17e9db3-2618-4ac0-bf64-2d91799532df tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:50.967232 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e17e9db3-2618-4ac0-bf64-2d91799532df tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:50.970661 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e17e9db3-2618-4ac0-bf64-2d91799532df tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:50.971435 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e17e9db3-2618-4ac0-bf64-2d91799532df tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:50.971899 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e17e9db3-2618-4ac0-bf64-2d91799532df tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:50.972319 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e17e9db3-2618-4ac0-bf64-2d91799532df tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:51.445500 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e17e9db3-2618-4ac0-bf64-2d91799532df tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:51.465802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e17e9db3-2618-4ac0-bf64-2d91799532df tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:51.471064 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e17e9db3-2618-4ac0-bf64-2d91799532df tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:51.473329 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e17e9db3-2618-4ac0-bf64-2d91799532df tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.532456 Aug 28 10:16:51.477198 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 98/192] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:50 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 28 10:16:51.538205 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-14919d69-035f-4162-a68d-310373f4b1ef tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:51.549953 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-14919d69-035f-4162-a68d-310373f4b1ef tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.647145 Aug 28 10:16:51.550572 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 95/193] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:50 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:51.583465 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-54e8396d-6a38-4d66-8fad-386b7857a727 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:51.584470 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-54e8396d-6a38-4d66-8fad-386b7857a727 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:51.595110 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54e8396d-6a38-4d66-8fad-386b7857a727 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:51.595595 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54e8396d-6a38-4d66-8fad-386b7857a727 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:51.596026 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54e8396d-6a38-4d66-8fad-386b7857a727 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:51.596750 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54e8396d-6a38-4d66-8fad-386b7857a727 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:51.597186 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54e8396d-6a38-4d66-8fad-386b7857a727 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:51.597608 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54e8396d-6a38-4d66-8fad-386b7857a727 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:51.647934 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-1a3386f6-48ea-441b-bae5-d24f7cf08563 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:51.650455 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-1a3386f6-48ea-441b-bae5-d24f7cf08563 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:51.665151 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1a3386f6-48ea-441b-bae5-d24f7cf08563 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:51.665633 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1a3386f6-48ea-441b-bae5-d24f7cf08563 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:51.666054 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1a3386f6-48ea-441b-bae5-d24f7cf08563 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:51.666754 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1a3386f6-48ea-441b-bae5-d24f7cf08563 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:51.667337 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1a3386f6-48ea-441b-bae5-d24f7cf08563 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:51.672151 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1a3386f6-48ea-441b-bae5-d24f7cf08563 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:51.827396 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-54e8396d-6a38-4d66-8fad-386b7857a727 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:51.842482 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-54e8396d-6a38-4d66-8fad-386b7857a727 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.263127 Aug 28 10:16:51.843344 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 99/194] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:51 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:51.856541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-1a3386f6-48ea-441b-bae5-d24f7cf08563 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:51.864450 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-1a3386f6-48ea-441b-bae5-d24f7cf08563 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.222263 Aug 28 10:16:51.865252 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 96/195] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:51 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:52.497983 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b18d2627-b25e-4176-8c52-a91bd1f05bf4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:52.500196 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b18d2627-b25e-4176-8c52-a91bd1f05bf4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:52.509296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b18d2627-b25e-4176-8c52-a91bd1f05bf4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:52.510815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b18d2627-b25e-4176-8c52-a91bd1f05bf4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:52.511782 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b18d2627-b25e-4176-8c52-a91bd1f05bf4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:52.513578 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b18d2627-b25e-4176-8c52-a91bd1f05bf4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:52.514566 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b18d2627-b25e-4176-8c52-a91bd1f05bf4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:52.515335 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b18d2627-b25e-4176-8c52-a91bd1f05bf4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:52.571261 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-a285e8a0-7f62-4206-a992-5d1bc186a466 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:52.571942 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-a285e8a0-7f62-4206-a992-5d1bc186a466 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:52.581382 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a285e8a0-7f62-4206-a992-5d1bc186a466 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:52.582555 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a285e8a0-7f62-4206-a992-5d1bc186a466 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:52.583073 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a285e8a0-7f62-4206-a992-5d1bc186a466 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:52.602508 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a285e8a0-7f62-4206-a992-5d1bc186a466 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:52.603089 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a285e8a0-7f62-4206-a992-5d1bc186a466 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:52.604148 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a285e8a0-7f62-4206-a992-5d1bc186a466 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:52.861203 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b18d2627-b25e-4176-8c52-a91bd1f05bf4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:52.869199 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-a285e8a0-7f62-4206-a992-5d1bc186a466 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:52.882714 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b18d2627-b25e-4176-8c52-a91bd1f05bf4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:52.884540 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b18d2627-b25e-4176-8c52-a91bd1f05bf4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:52.885823 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b18d2627-b25e-4176-8c52-a91bd1f05bf4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.393869 Aug 28 10:16:52.886593 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 100/196] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:52 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:52.891994 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-f76e1df0-29c4-4e55-a455-cdc9c8cb1c37 req-a664ef46-f889-496d-a045-339e8136578a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a0819fc-2347-457b-804f-7ef819596193", "name": "network-vif-plugged", "status": "completed", "tag": "fe1c34ee-5586-4bd0-a9a5-7cc7349b7bd2"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:16:52.901209 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-f76e1df0-29c4-4e55-a455-cdc9c8cb1c37 req-a664ef46-f889-496d-a045-339e8136578a service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:52.902062 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-f76e1df0-29c4-4e55-a455-cdc9c8cb1c37 req-a664ef46-f889-496d-a045-339e8136578a service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:52.902727 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-f76e1df0-29c4-4e55-a455-cdc9c8cb1c37 req-a664ef46-f889-496d-a045-339e8136578a service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:52.905132 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-a285e8a0-7f62-4206-a992-5d1bc186a466 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.337561 Aug 28 10:16:52.906851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 97/197] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:52 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:16:52.917316 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-dd5bd1b9-56ff-4655-8765-11201239ed7c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:52.920539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-dd5bd1b9-56ff-4655-8765-11201239ed7c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:52.927119 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-dd5bd1b9-56ff-4655-8765-11201239ed7c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:52.927751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-dd5bd1b9-56ff-4655-8765-11201239ed7c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:52.928317 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-dd5bd1b9-56ff-4655-8765-11201239ed7c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:52.929234 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-dd5bd1b9-56ff-4655-8765-11201239ed7c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:52.929775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-dd5bd1b9-56ff-4655-8765-11201239ed7c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:52.930327 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-dd5bd1b9-56ff-4655-8765-11201239ed7c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:52.935084 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=100 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:52.944146 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-f76e1df0-29c4-4e55-a455-cdc9c8cb1c37 req-a664ef46-f889-496d-a045-339e8136578a service nova] Creating event network-vif-plugged:fe1c34ee-5586-4bd0-a9a5-7cc7349b7bd2 for instance 2a0819fc-2347-457b-804f-7ef819596193 on hv-cinder-85200 Aug 28 10:16:52.954374 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-f76e1df0-29c4-4e55-a455-cdc9c8cb1c37 req-a664ef46-f889-496d-a045-339e8136578a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065194 Aug 28 10:16:52.956752 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 101/198] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:16:52.973881 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-12b7c8ea-983d-4989-83ce-1082d9f7d60b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:52.977569 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-12b7c8ea-983d-4989-83ce-1082d9f7d60b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:52.985634 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12b7c8ea-983d-4989-83ce-1082d9f7d60b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:52.986228 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12b7c8ea-983d-4989-83ce-1082d9f7d60b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:52.987139 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12b7c8ea-983d-4989-83ce-1082d9f7d60b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:52.987992 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12b7c8ea-983d-4989-83ce-1082d9f7d60b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:52.989148 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12b7c8ea-983d-4989-83ce-1082d9f7d60b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:52.989757 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12b7c8ea-983d-4989-83ce-1082d9f7d60b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:53.032267 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:53.171266 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-dd5bd1b9-56ff-4655-8765-11201239ed7c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:53.181033 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-dd5bd1b9-56ff-4655-8765-11201239ed7c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.272803 Aug 28 10:16:53.184081 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 98/199] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:52 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:53.231361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-12b7c8ea-983d-4989-83ce-1082d9f7d60b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:53.240652 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-12b7c8ea-983d-4989-83ce-1082d9f7d60b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.281515 Aug 28 10:16:53.256182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 102/200] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:52 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:53.913160 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-7ae53c9a-a534-4a66-9f17-d6d83b487214 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:53.917160 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-7ae53c9a-a534-4a66-9f17-d6d83b487214 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:53.928349 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a3f55036-b8ca-4f69-af45-078049104af4 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:53.928976 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a3f55036-b8ca-4f69-af45-078049104af4 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:53.937490 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a3f55036-b8ca-4f69-af45-078049104af4 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:53.938127 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a3f55036-b8ca-4f69-af45-078049104af4 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:53.938243 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7ae53c9a-a534-4a66-9f17-d6d83b487214 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:53.938749 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7ae53c9a-a534-4a66-9f17-d6d83b487214 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:53.939608 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7ae53c9a-a534-4a66-9f17-d6d83b487214 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:53.940724 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7ae53c9a-a534-4a66-9f17-d6d83b487214 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:53.941837 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7ae53c9a-a534-4a66-9f17-d6d83b487214 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:53.942637 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7ae53c9a-a534-4a66-9f17-d6d83b487214 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:53.943975 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a3f55036-b8ca-4f69-af45-078049104af4 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:53.944966 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a3f55036-b8ca-4f69-af45-078049104af4 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:53.948130 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a3f55036-b8ca-4f69-af45-078049104af4 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:53.948677 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a3f55036-b8ca-4f69-af45-078049104af4 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:54.158809 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7ae53c9a-a534-4a66-9f17-d6d83b487214 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:54.167530 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7ae53c9a-a534-4a66-9f17-d6d83b487214 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:54.169422 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7ae53c9a-a534-4a66-9f17-d6d83b487214 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:54.170992 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-7ae53c9a-a534-4a66-9f17-d6d83b487214 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.263427 Aug 28 10:16:54.184826 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a3f55036-b8ca-4f69-af45-078049104af4 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:54.185534 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 99/201] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:53 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:54.192538 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a3f55036-b8ca-4f69-af45-078049104af4 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.268260 Aug 28 10:16:54.193544 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 103/202] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:53 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:16:54.210704 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-ca241820-206f-45fc-a634-e259979713f1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:54.211314 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-ca241820-206f-45fc-a634-e259979713f1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:54.220745 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ca241820-206f-45fc-a634-e259979713f1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:54.221642 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ca241820-206f-45fc-a634-e259979713f1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:54.222657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ca241820-206f-45fc-a634-e259979713f1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:54.223363 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ca241820-206f-45fc-a634-e259979713f1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:54.223837 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ca241820-206f-45fc-a634-e259979713f1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:54.224252 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ca241820-206f-45fc-a634-e259979713f1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:54.263144 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e0449f6a-0e89-4836-8a2c-03e75b6e2d60 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:54.264025 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e0449f6a-0e89-4836-8a2c-03e75b6e2d60 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:54.270003 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0449f6a-0e89-4836-8a2c-03e75b6e2d60 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:54.270477 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0449f6a-0e89-4836-8a2c-03e75b6e2d60 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:54.270892 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0449f6a-0e89-4836-8a2c-03e75b6e2d60 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:54.271563 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0449f6a-0e89-4836-8a2c-03e75b6e2d60 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:54.271998 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0449f6a-0e89-4836-8a2c-03e75b6e2d60 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:54.272543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0449f6a-0e89-4836-8a2c-03e75b6e2d60 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:54.569403 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-ca241820-206f-45fc-a634-e259979713f1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:54.577326 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-ca241820-206f-45fc-a634-e259979713f1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.375198 Aug 28 10:16:54.595910 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 100/203] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:54 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:54.620253 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e0449f6a-0e89-4836-8a2c-03e75b6e2d60 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:54.630233 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e0449f6a-0e89-4836-8a2c-03e75b6e2d60 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.370910 Aug 28 10:16:54.630827 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 104/204] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:54 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:16:54.971657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-5f101112-7605-4369-9ac3-e2f2770bfb6a req-50941bd5-f908-4172-b4fb-988585b97347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c703c468-fcfc-41a1-ae56-4b9a516378ed", "name": "network-vif-plugged", "status": "completed", "tag": "f4f9d7ba-0d95-4c3b-b146-58f4b088e007"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:16:54.981736 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-5f101112-7605-4369-9ac3-e2f2770bfb6a req-50941bd5-f908-4172-b4fb-988585b97347 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:54.982279 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-5f101112-7605-4369-9ac3-e2f2770bfb6a req-50941bd5-f908-4172-b4fb-988585b97347 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:54.982896 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-5f101112-7605-4369-9ac3-e2f2770bfb6a req-50941bd5-f908-4172-b4fb-988585b97347 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:54.995540 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-5f101112-7605-4369-9ac3-e2f2770bfb6a req-50941bd5-f908-4172-b4fb-988585b97347 service nova] Creating event network-vif-plugged:f4f9d7ba-0d95-4c3b-b146-58f4b088e007 for instance c703c468-fcfc-41a1-ae56-4b9a516378ed on hv-cinder-85200 Aug 28 10:16:55.000798 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-5f101112-7605-4369-9ac3-e2f2770bfb6a req-50941bd5-f908-4172-b4fb-988585b97347 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032941 Aug 28 10:16:55.001503 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 101/205] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:16:55.196148 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-447126ce-95fb-43b3-b2c8-7b59aae3fc75 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:55.196148 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-447126ce-95fb-43b3-b2c8-7b59aae3fc75 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:55.208327 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-447126ce-95fb-43b3-b2c8-7b59aae3fc75 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:55.208825 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-447126ce-95fb-43b3-b2c8-7b59aae3fc75 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:55.209244 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-447126ce-95fb-43b3-b2c8-7b59aae3fc75 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:55.209926 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-447126ce-95fb-43b3-b2c8-7b59aae3fc75 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:55.210371 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-447126ce-95fb-43b3-b2c8-7b59aae3fc75 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:55.210778 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-447126ce-95fb-43b3-b2c8-7b59aae3fc75 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:55.221620 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c9dd901b-d3db-4a11-8f3f-692f5265c52b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:55.223907 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c9dd901b-d3db-4a11-8f3f-692f5265c52b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:55.235861 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c9dd901b-d3db-4a11-8f3f-692f5265c52b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:55.236630 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c9dd901b-d3db-4a11-8f3f-692f5265c52b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:55.237286 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c9dd901b-d3db-4a11-8f3f-692f5265c52b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:55.238200 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c9dd901b-d3db-4a11-8f3f-692f5265c52b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:55.238694 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c9dd901b-d3db-4a11-8f3f-692f5265c52b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:55.239286 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c9dd901b-d3db-4a11-8f3f-692f5265c52b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:55.434218 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-447126ce-95fb-43b3-b2c8-7b59aae3fc75 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:55.443268 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-447126ce-95fb-43b3-b2c8-7b59aae3fc75 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:55.444816 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-447126ce-95fb-43b3-b2c8-7b59aae3fc75 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:55.446181 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-447126ce-95fb-43b3-b2c8-7b59aae3fc75 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.255398 Aug 28 10:16:55.447262 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 105/206] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:55 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:55.456605 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c9dd901b-d3db-4a11-8f3f-692f5265c52b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:55.469279 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c9dd901b-d3db-4a11-8f3f-692f5265c52b tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1314 microversion: 2.1 time: 0.253291 Aug 28 10:16:55.469879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 102/207] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:55 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:16:55.597849 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5972d56d-7eae-446e-b861-e0433d764fc1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:55.598446 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5972d56d-7eae-446e-b861-e0433d764fc1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:55.610512 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5972d56d-7eae-446e-b861-e0433d764fc1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:55.611000 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5972d56d-7eae-446e-b861-e0433d764fc1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:55.611546 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5972d56d-7eae-446e-b861-e0433d764fc1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:55.612729 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5972d56d-7eae-446e-b861-e0433d764fc1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:55.614984 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5972d56d-7eae-446e-b861-e0433d764fc1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:55.616231 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5972d56d-7eae-446e-b861-e0433d764fc1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:55.651246 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-123713fa-0136-4070-ab58-ea9892ff1ed0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:55.652388 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-123713fa-0136-4070-ab58-ea9892ff1ed0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:55.672347 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-123713fa-0136-4070-ab58-ea9892ff1ed0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:55.676895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-123713fa-0136-4070-ab58-ea9892ff1ed0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:55.677756 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-123713fa-0136-4070-ab58-ea9892ff1ed0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:55.679426 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-123713fa-0136-4070-ab58-ea9892ff1ed0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:55.679890 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-123713fa-0136-4070-ab58-ea9892ff1ed0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:55.680321 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-123713fa-0136-4070-ab58-ea9892ff1ed0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:56.041023 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5972d56d-7eae-446e-b861-e0433d764fc1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:56.065707 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5972d56d-7eae-446e-b861-e0433d764fc1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.471782 Aug 28 10:16:56.066309 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 106/208] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:55 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:56.088391 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-123713fa-0136-4070-ab58-ea9892ff1ed0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:56.096640 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-123713fa-0136-4070-ab58-ea9892ff1ed0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.449152 Aug 28 10:16:56.101341 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 103/209] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:55 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:56.471896 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b72c8c5d-de81-4a45-866e-17387e6ade2b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:56.472660 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b72c8c5d-de81-4a45-866e-17387e6ade2b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:56.479130 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b72c8c5d-de81-4a45-866e-17387e6ade2b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:56.480021 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b72c8c5d-de81-4a45-866e-17387e6ade2b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:56.480709 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b72c8c5d-de81-4a45-866e-17387e6ade2b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:56.481629 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b72c8c5d-de81-4a45-866e-17387e6ade2b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:56.482273 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b72c8c5d-de81-4a45-866e-17387e6ade2b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:56.482886 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b72c8c5d-de81-4a45-866e-17387e6ade2b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:56.490683 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-9d26b51b-5d00-4ebb-888e-f4bf223ce84c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:56.491604 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-9d26b51b-5d00-4ebb-888e-f4bf223ce84c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:56.502320 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9d26b51b-5d00-4ebb-888e-f4bf223ce84c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:56.503159 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9d26b51b-5d00-4ebb-888e-f4bf223ce84c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:56.503783 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9d26b51b-5d00-4ebb-888e-f4bf223ce84c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:56.504781 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9d26b51b-5d00-4ebb-888e-f4bf223ce84c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:56.521269 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9d26b51b-5d00-4ebb-888e-f4bf223ce84c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:56.529648 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9d26b51b-5d00-4ebb-888e-f4bf223ce84c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:56.794481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b72c8c5d-de81-4a45-866e-17387e6ade2b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:56.808806 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b72c8c5d-de81-4a45-866e-17387e6ade2b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:56.809048 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b72c8c5d-de81-4a45-866e-17387e6ade2b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:56.810001 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b72c8c5d-de81-4a45-866e-17387e6ade2b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.342373 Aug 28 10:16:56.825517 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 107/210] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:56 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:56.827317 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-9d26b51b-5d00-4ebb-888e-f4bf223ce84c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:56.838160 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-9d26b51b-5d00-4ebb-888e-f4bf223ce84c tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1500 microversion: 2.1 time: 0.351626 Aug 28 10:16:56.838779 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 104/211] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:56 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1500 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:16:57.089573 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-afa74a3b-d0b2-48e4-aca9-ac349ea3a590 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:57.091329 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-afa74a3b-d0b2-48e4-aca9-ac349ea3a590 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:57.101199 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-afa74a3b-d0b2-48e4-aca9-ac349ea3a590 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:57.101956 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-afa74a3b-d0b2-48e4-aca9-ac349ea3a590 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:57.102611 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-afa74a3b-d0b2-48e4-aca9-ac349ea3a590 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:57.103704 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-afa74a3b-d0b2-48e4-aca9-ac349ea3a590 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:57.104344 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-afa74a3b-d0b2-48e4-aca9-ac349ea3a590 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:57.104934 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-afa74a3b-d0b2-48e4-aca9-ac349ea3a590 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:57.117504 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-3ba64f57-5678-422d-954a-1dbfbc281a69 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:57.118247 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-3ba64f57-5678-422d-954a-1dbfbc281a69 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:57.125767 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3ba64f57-5678-422d-954a-1dbfbc281a69 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:57.126291 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3ba64f57-5678-422d-954a-1dbfbc281a69 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:57.126753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3ba64f57-5678-422d-954a-1dbfbc281a69 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:57.127406 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3ba64f57-5678-422d-954a-1dbfbc281a69 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:57.130262 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3ba64f57-5678-422d-954a-1dbfbc281a69 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:57.138113 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3ba64f57-5678-422d-954a-1dbfbc281a69 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:57.743722 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-afa74a3b-d0b2-48e4-aca9-ac349ea3a590 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:57.756611 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-afa74a3b-d0b2-48e4-aca9-ac349ea3a590 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1367 microversion: 2.1 time: 0.672591 Aug 28 10:16:57.771572 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 108/212] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:57 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1367 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:57.834751 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fe685286-bb56-43ea-9469-628185f4e3e1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:57.835358 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fe685286-bb56-43ea-9469-628185f4e3e1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:57.846016 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fe685286-bb56-43ea-9469-628185f4e3e1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:57.846505 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fe685286-bb56-43ea-9469-628185f4e3e1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:57.846927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fe685286-bb56-43ea-9469-628185f4e3e1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:57.847781 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fe685286-bb56-43ea-9469-628185f4e3e1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:57.851289 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-3ba64f57-5678-422d-954a-1dbfbc281a69 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:57.859527 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-3ba64f57-5678-422d-954a-1dbfbc281a69 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.745901 Aug 28 10:16:57.860113 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 105/213] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:57 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:16:57.860235 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fe685286-bb56-43ea-9469-628185f4e3e1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:57.860729 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fe685286-bb56-43ea-9469-628185f4e3e1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:58.003294 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fe685286-bb56-43ea-9469-628185f4e3e1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:58.012919 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fe685286-bb56-43ea-9469-628185f4e3e1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:58.014035 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fe685286-bb56-43ea-9469-628185f4e3e1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:58.015561 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fe685286-bb56-43ea-9469-628185f4e3e1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1407 microversion: 2.20 time: 0.185086 Aug 28 10:16:58.016257 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 109/214] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:57 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 28 10:16:58.465652 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-eed107fc-77ea-4ae4-9496-121969cccbd3 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "290e6b61-7809-41f4-93ab-0cedf4204a9e"}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:16:58.468040 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-eed107fc-77ea-4ae4-9496-121969cccbd3 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:58.480203 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-eed107fc-77ea-4ae4-9496-121969cccbd3 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:58.481084 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-eed107fc-77ea-4ae4-9496-121969cccbd3 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:58.482364 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-eed107fc-77ea-4ae4-9496-121969cccbd3 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:58.483595 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-eed107fc-77ea-4ae4-9496-121969cccbd3 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:58.484343 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-eed107fc-77ea-4ae4-9496-121969cccbd3 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:58.484918 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-eed107fc-77ea-4ae4-9496-121969cccbd3 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:58.777297 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d3fc6356-b3ef-475a-a9cc-4a075de9dac4 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:58.777893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d3fc6356-b3ef-475a-a9cc-4a075de9dac4 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:58.784625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3fc6356-b3ef-475a-a9cc-4a075de9dac4 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:58.785257 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3fc6356-b3ef-475a-a9cc-4a075de9dac4 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:58.785837 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3fc6356-b3ef-475a-a9cc-4a075de9dac4 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:58.786738 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3fc6356-b3ef-475a-a9cc-4a075de9dac4 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:58.787511 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3fc6356-b3ef-475a-a9cc-4a075de9dac4 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:58.788222 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3fc6356-b3ef-475a-a9cc-4a075de9dac4 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:59.021923 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d3fc6356-b3ef-475a-a9cc-4a075de9dac4 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:59.030728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d3fc6356-b3ef-475a-a9cc-4a075de9dac4 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1557 microversion: 2.1 time: 0.257162 Aug 28 10:16:59.031662 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 110/215] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:58 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1557 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:59.049944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-0d56eae0-221f-4bf8-8481-539b62c6f73b req-dcecdf24-627c-4f6a-854f-98f402bf7c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5016c8b-754f-45cf-b06d-a76bc62afb13", "name": "network-vif-plugged", "status": "completed", "tag": "4ac906a4-9f4d-413f-b675-c5b1fa08afbb"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:16:59.059765 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-0d56eae0-221f-4bf8-8481-539b62c6f73b req-dcecdf24-627c-4f6a-854f-98f402bf7c15 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:59.060242 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-0d56eae0-221f-4bf8-8481-539b62c6f73b req-dcecdf24-627c-4f6a-854f-98f402bf7c15 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:59.060699 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-0d56eae0-221f-4bf8-8481-539b62c6f73b req-dcecdf24-627c-4f6a-854f-98f402bf7c15 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:59.073242 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-0d56eae0-221f-4bf8-8481-539b62c6f73b req-dcecdf24-627c-4f6a-854f-98f402bf7c15 service nova] Creating event network-vif-plugged:4ac906a4-9f4d-413f-b675-c5b1fa08afbb for instance a5016c8b-754f-45cf-b06d-a76bc62afb13 on hv-cinder-85200 Aug 28 10:16:59.079214 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-0d56eae0-221f-4bf8-8481-539b62c6f73b req-dcecdf24-627c-4f6a-854f-98f402bf7c15 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033364 Aug 28 10:16:59.080043 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 111/216] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:16:59.088973 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4b294806-58ce-4232-8aae-4172a938f7f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:59.089987 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4b294806-58ce-4232-8aae-4172a938f7f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:59.098450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4b294806-58ce-4232-8aae-4172a938f7f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:59.098673 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4b294806-58ce-4232-8aae-4172a938f7f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:59.098936 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4b294806-58ce-4232-8aae-4172a938f7f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:59.099743 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4b294806-58ce-4232-8aae-4172a938f7f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:59.100181 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4b294806-58ce-4232-8aae-4172a938f7f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:59.100622 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4b294806-58ce-4232-8aae-4172a938f7f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:59.244436 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4b294806-58ce-4232-8aae-4172a938f7f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:59.253612 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4b294806-58ce-4232-8aae-4172a938f7f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.172298 Aug 28 10:16:59.254601 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 112/217] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:16:59 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:16:59.260810 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b6ef7800-2d00-4f9a-94b2-f4814c4f4b37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:59.262182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b6ef7800-2d00-4f9a-94b2-f4814c4f4b37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:59.274942 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b6ef7800-2d00-4f9a-94b2-f4814c4f4b37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:59.275428 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b6ef7800-2d00-4f9a-94b2-f4814c4f4b37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:59.275851 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b6ef7800-2d00-4f9a-94b2-f4814c4f4b37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:59.276756 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b6ef7800-2d00-4f9a-94b2-f4814c4f4b37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:59.277804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b6ef7800-2d00-4f9a-94b2-f4814c4f4b37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:59.278226 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b6ef7800-2d00-4f9a-94b2-f4814c4f4b37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:59.425285 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b6ef7800-2d00-4f9a-94b2-f4814c4f4b37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:59.433493 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b6ef7800-2d00-4f9a-94b2-f4814c4f4b37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:59.435341 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b6ef7800-2d00-4f9a-94b2-f4814c4f4b37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:16:59.437733 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b6ef7800-2d00-4f9a-94b2-f4814c4f4b37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1599 microversion: 2.20 time: 0.181141 Aug 28 10:16:59.453086 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 113/218] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:16:59 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1599 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:16:59.461206 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e4bc5aa5-c1ec-406b-84fb-f4e351b81277 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:59.461783 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e4bc5aa5-c1ec-406b-84fb-f4e351b81277 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:59.468040 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4bc5aa5-c1ec-406b-84fb-f4e351b81277 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:59.468534 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4bc5aa5-c1ec-406b-84fb-f4e351b81277 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:59.468967 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4bc5aa5-c1ec-406b-84fb-f4e351b81277 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:59.469642 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4bc5aa5-c1ec-406b-84fb-f4e351b81277 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:59.470242 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4bc5aa5-c1ec-406b-84fb-f4e351b81277 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:59.470653 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4bc5aa5-c1ec-406b-84fb-f4e351b81277 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:59.587885 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e4bc5aa5-c1ec-406b-84fb-f4e351b81277 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.133438 Aug 28 10:16:59.589011 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 114/219] 10.222.0.40 () {58 vars in 1275 bytes} [Sun Aug 28 10:16:59 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:16:59.593952 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b1bea615-5af9-4b0b-a6d7-fc8c631c2139 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:16:59.594434 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b1bea615-5af9-4b0b-a6d7-fc8c631c2139 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:16:59.605574 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b1bea615-5af9-4b0b-a6d7-fc8c631c2139 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:59.605574 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b1bea615-5af9-4b0b-a6d7-fc8c631c2139 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:59.605574 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b1bea615-5af9-4b0b-a6d7-fc8c631c2139 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:59.605574 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b1bea615-5af9-4b0b-a6d7-fc8c631c2139 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:16:59.605840 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b1bea615-5af9-4b0b-a6d7-fc8c631c2139 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:16:59.605840 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b1bea615-5af9-4b0b-a6d7-fc8c631c2139 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:16:59.690459 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b1bea615-5af9-4b0b-a6d7-fc8c631c2139 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.100312 Aug 28 10:16:59.698021 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 115/220] 10.222.0.40 () {60 vars in 1316 bytes} [Sun Aug 28 10:16:59 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 28 10:17:00.275127 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b253a332-8bdd-4358-b2c3-6721284fbc61 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:00.275754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b253a332-8bdd-4358-b2c3-6721284fbc61 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:00.285416 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b253a332-8bdd-4358-b2c3-6721284fbc61 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:00.285895 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b253a332-8bdd-4358-b2c3-6721284fbc61 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:00.286318 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b253a332-8bdd-4358-b2c3-6721284fbc61 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:00.291480 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b253a332-8bdd-4358-b2c3-6721284fbc61 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:00.292191 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b253a332-8bdd-4358-b2c3-6721284fbc61 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:00.292841 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b253a332-8bdd-4358-b2c3-6721284fbc61 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:00.615376 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b253a332-8bdd-4358-b2c3-6721284fbc61 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:00.624317 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b253a332-8bdd-4358-b2c3-6721284fbc61 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.353870 Aug 28 10:17:00.637373 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 116/221] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:00 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:01.240411 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-08e93e60-0e05-41b8-ad4d-c74d44609545 req-64156f85-e102-4992-8f51-93b45ca35b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c41bc126-2936-43a3-a819-e9433bb7f8f4", "tag": "f3149d41-a93c-4c32-b02d-c9686354c16c"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:17:01.254212 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-08e93e60-0e05-41b8-ad4d-c74d44609545 req-64156f85-e102-4992-8f51-93b45ca35b88 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:01.255145 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-08e93e60-0e05-41b8-ad4d-c74d44609545 req-64156f85-e102-4992-8f51-93b45ca35b88 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:01.256028 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-08e93e60-0e05-41b8-ad4d-c74d44609545 req-64156f85-e102-4992-8f51-93b45ca35b88 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:01.274979 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-08e93e60-0e05-41b8-ad4d-c74d44609545 req-64156f85-e102-4992-8f51-93b45ca35b88 service nova] Creating event network-changed:f3149d41-a93c-4c32-b02d-c9686354c16c for instance c41bc126-2936-43a3-a819-e9433bb7f8f4 on hv-cinder-85200 Aug 28 10:17:01.283792 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-08e93e60-0e05-41b8-ad4d-c74d44609545 req-64156f85-e102-4992-8f51-93b45ca35b88 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048052 Aug 28 10:17:01.286059 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 117/222] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:17:01.464746 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-83a1c5a4-f905-431c-864c-ea9fdc6ce207 req-63c01aa8-675c-429c-81be-cd0bd74efdf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a0819fc-2347-457b-804f-7ef819596193", "tag": "fe1c34ee-5586-4bd0-a9a5-7cc7349b7bd2"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:17:01.474973 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-83a1c5a4-f905-431c-864c-ea9fdc6ce207 req-63c01aa8-675c-429c-81be-cd0bd74efdf9 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:01.475449 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-83a1c5a4-f905-431c-864c-ea9fdc6ce207 req-63c01aa8-675c-429c-81be-cd0bd74efdf9 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:01.475924 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-83a1c5a4-f905-431c-864c-ea9fdc6ce207 req-63c01aa8-675c-429c-81be-cd0bd74efdf9 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:01.489181 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-83a1c5a4-f905-431c-864c-ea9fdc6ce207 req-63c01aa8-675c-429c-81be-cd0bd74efdf9 service nova] Creating event network-changed:fe1c34ee-5586-4bd0-a9a5-7cc7349b7bd2 for instance 2a0819fc-2347-457b-804f-7ef819596193 on hv-cinder-85200 Aug 28 10:17:01.496054 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-83a1c5a4-f905-431c-864c-ea9fdc6ce207 req-63c01aa8-675c-429c-81be-cd0bd74efdf9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035071 Aug 28 10:17:01.500988 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 118/223] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:17:01.648823 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dbfd8493-d878-42b3-8101-510719127221 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:01.649654 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-dbfd8493-d878-42b3-8101-510719127221 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:01.659897 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbfd8493-d878-42b3-8101-510719127221 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:01.660653 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbfd8493-d878-42b3-8101-510719127221 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:01.661251 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbfd8493-d878-42b3-8101-510719127221 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:01.662412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbfd8493-d878-42b3-8101-510719127221 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:01.664712 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbfd8493-d878-42b3-8101-510719127221 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:01.665393 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbfd8493-d878-42b3-8101-510719127221 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:01.828651 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dbfd8493-d878-42b3-8101-510719127221 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:01.838532 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-dbfd8493-d878-42b3-8101-510719127221 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.194796 Aug 28 10:17:01.839210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 119/224] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:01 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:17:02.859183 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1a271e92-81a4-4d41-b683-dc23f938b12f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:02.860082 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1a271e92-81a4-4d41-b683-dc23f938b12f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:02.866912 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a271e92-81a4-4d41-b683-dc23f938b12f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:02.867398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a271e92-81a4-4d41-b683-dc23f938b12f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:02.867819 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a271e92-81a4-4d41-b683-dc23f938b12f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:02.868588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a271e92-81a4-4d41-b683-dc23f938b12f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:02.868969 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a271e92-81a4-4d41-b683-dc23f938b12f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:02.869378 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a271e92-81a4-4d41-b683-dc23f938b12f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:03.013533 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1a271e92-81a4-4d41-b683-dc23f938b12f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:03.024183 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1a271e92-81a4-4d41-b683-dc23f938b12f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.169204 Aug 28 10:17:03.024956 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 120/225] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:02 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:17:04.048174 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-306dff9e-7e28-4643-b2c5-ed80b9e32acd tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:04.048945 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-306dff9e-7e28-4643-b2c5-ed80b9e32acd tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:04.055267 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-306dff9e-7e28-4643-b2c5-ed80b9e32acd tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:04.056193 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-306dff9e-7e28-4643-b2c5-ed80b9e32acd tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:04.056664 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-306dff9e-7e28-4643-b2c5-ed80b9e32acd tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:04.057441 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-306dff9e-7e28-4643-b2c5-ed80b9e32acd tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:04.057897 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-306dff9e-7e28-4643-b2c5-ed80b9e32acd tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:04.058484 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-306dff9e-7e28-4643-b2c5-ed80b9e32acd tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:04.236982 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-306dff9e-7e28-4643-b2c5-ed80b9e32acd tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:04.241428 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:04.249544 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-306dff9e-7e28-4643-b2c5-ed80b9e32acd tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.206936 Aug 28 10:17:04.250763 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 121/226] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:04 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:05.271723 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bfdeb1c0-04b0-4d81-a1de-293c1cbf63f1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:05.272383 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bfdeb1c0-04b0-4d81-a1de-293c1cbf63f1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:05.278636 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bfdeb1c0-04b0-4d81-a1de-293c1cbf63f1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:05.279118 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bfdeb1c0-04b0-4d81-a1de-293c1cbf63f1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:05.279537 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bfdeb1c0-04b0-4d81-a1de-293c1cbf63f1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:05.280217 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bfdeb1c0-04b0-4d81-a1de-293c1cbf63f1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:05.280689 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bfdeb1c0-04b0-4d81-a1de-293c1cbf63f1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:05.281097 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bfdeb1c0-04b0-4d81-a1de-293c1cbf63f1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:05.413158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bfdeb1c0-04b0-4d81-a1de-293c1cbf63f1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:05.421389 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bfdeb1c0-04b0-4d81-a1de-293c1cbf63f1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.154032 Aug 28 10:17:05.422244 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 122/227] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:05 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:06.446070 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-13cb5bc0-cd1a-435a-9150-df34aed64191 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:06.447102 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-13cb5bc0-cd1a-435a-9150-df34aed64191 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:06.457123 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-13cb5bc0-cd1a-435a-9150-df34aed64191 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:06.457905 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-13cb5bc0-cd1a-435a-9150-df34aed64191 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:06.458604 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-13cb5bc0-cd1a-435a-9150-df34aed64191 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:06.459709 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-13cb5bc0-cd1a-435a-9150-df34aed64191 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:06.460435 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-13cb5bc0-cd1a-435a-9150-df34aed64191 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:06.461165 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-13cb5bc0-cd1a-435a-9150-df34aed64191 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:06.599761 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-13cb5bc0-cd1a-435a-9150-df34aed64191 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:06.607629 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-13cb5bc0-cd1a-435a-9150-df34aed64191 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.168159 Aug 28 10:17:06.608203 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 123/228] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:06 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:07.627256 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a8a99795-ac26-4bf1-a41c-303f1688ae4b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:07.627924 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a8a99795-ac26-4bf1-a41c-303f1688ae4b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:07.634099 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8a99795-ac26-4bf1-a41c-303f1688ae4b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:07.634567 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8a99795-ac26-4bf1-a41c-303f1688ae4b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:07.635044 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8a99795-ac26-4bf1-a41c-303f1688ae4b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:07.635747 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8a99795-ac26-4bf1-a41c-303f1688ae4b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:07.636176 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8a99795-ac26-4bf1-a41c-303f1688ae4b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:07.636956 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8a99795-ac26-4bf1-a41c-303f1688ae4b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:07.768166 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a8a99795-ac26-4bf1-a41c-303f1688ae4b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:07.776142 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a8a99795-ac26-4bf1-a41c-303f1688ae4b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.152786 Aug 28 10:17:07.776755 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 124/229] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:07 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:08.477923 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=57 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:08.639649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=48 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:08.798374 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b126a377-c7e9-4004-97c7-ef9e1f971327 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:08.799363 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b126a377-c7e9-4004-97c7-ef9e1f971327 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:08.809554 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b126a377-c7e9-4004-97c7-ef9e1f971327 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:08.810340 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b126a377-c7e9-4004-97c7-ef9e1f971327 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:08.811041 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b126a377-c7e9-4004-97c7-ef9e1f971327 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:08.812152 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b126a377-c7e9-4004-97c7-ef9e1f971327 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:08.812948 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b126a377-c7e9-4004-97c7-ef9e1f971327 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:08.813631 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b126a377-c7e9-4004-97c7-ef9e1f971327 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:08.958175 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b126a377-c7e9-4004-97c7-ef9e1f971327 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:08.970396 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b126a377-c7e9-4004-97c7-ef9e1f971327 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.177756 Aug 28 10:17:08.971197 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 125/230] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:08 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:09.384313 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-eed107fc-77ea-4ae4-9496-121969cccbd3 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "POST /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.922509 Aug 28 10:17:09.384960 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 106/231] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Aug 28 10:16:58 2022] POST /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4/os-volume_attachments => generated 194 bytes in 10924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:17:09.995925 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0a548adc-888a-4d4a-9029-4128387c825b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:09.996647 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0a548adc-888a-4d4a-9029-4128387c825b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:10.014091 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0a548adc-888a-4d4a-9029-4128387c825b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:10.014794 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0a548adc-888a-4d4a-9029-4128387c825b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:10.015225 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0a548adc-888a-4d4a-9029-4128387c825b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:10.015923 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0a548adc-888a-4d4a-9029-4128387c825b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:10.016369 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0a548adc-888a-4d4a-9029-4128387c825b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:10.017113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0a548adc-888a-4d4a-9029-4128387c825b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:10.265333 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0a548adc-888a-4d4a-9029-4128387c825b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:10.272289 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0a548adc-888a-4d4a-9029-4128387c825b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.280948 Aug 28 10:17:10.273264 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 126/232] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:09 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:17:11.295628 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e290768c-b95e-473e-96c4-81a9e13ca6e5 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:11.296308 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e290768c-b95e-473e-96c4-81a9e13ca6e5 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:11.308820 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e290768c-b95e-473e-96c4-81a9e13ca6e5 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:11.309574 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e290768c-b95e-473e-96c4-81a9e13ca6e5 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:11.312242 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e290768c-b95e-473e-96c4-81a9e13ca6e5 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:11.313305 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e290768c-b95e-473e-96c4-81a9e13ca6e5 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:11.317657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e290768c-b95e-473e-96c4-81a9e13ca6e5 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:11.318954 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e290768c-b95e-473e-96c4-81a9e13ca6e5 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:11.528187 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-e290768c-b95e-473e-96c4-81a9e13ca6e5 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:11.545364 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-e290768c-b95e-473e-96c4-81a9e13ca6e5 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1322 microversion: 2.1 time: 0.251845 Aug 28 10:17:11.546520 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 107/233] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:11 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:12.565995 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b909fce8-ee86-4c6e-a692-73b0005c89b1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:12.567345 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b909fce8-ee86-4c6e-a692-73b0005c89b1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:12.579523 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b909fce8-ee86-4c6e-a692-73b0005c89b1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:12.580275 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b909fce8-ee86-4c6e-a692-73b0005c89b1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:12.581150 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b909fce8-ee86-4c6e-a692-73b0005c89b1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:12.582276 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b909fce8-ee86-4c6e-a692-73b0005c89b1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:12.582884 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b909fce8-ee86-4c6e-a692-73b0005c89b1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:12.583312 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b909fce8-ee86-4c6e-a692-73b0005c89b1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:12.816213 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b909fce8-ee86-4c6e-a692-73b0005c89b1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:12.836785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b909fce8-ee86-4c6e-a692-73b0005c89b1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1517 microversion: 2.1 time: 0.263884 Aug 28 10:17:12.836785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 127/234] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:12 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1517 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:12.858358 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-3104b60c-e069-450f-97f3-f158721319a6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:17:12.861010 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-3104b60c-e069-450f-97f3-f158721319a6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:12.868553 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3104b60c-e069-450f-97f3-f158721319a6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:12.869033 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3104b60c-e069-450f-97f3-f158721319a6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:12.869467 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3104b60c-e069-450f-97f3-f158721319a6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:12.870180 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3104b60c-e069-450f-97f3-f158721319a6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:12.870628 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3104b60c-e069-450f-97f3-f158721319a6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:12.871040 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3104b60c-e069-450f-97f3-f158721319a6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:12.897038 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.objects.instance [None req-3104b60c-e069-450f-97f3-f158721319a6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lazy-loading 'flavor' on Instance uuid a5016c8b-754f-45cf-b06d-a76bc62afb13 {{(pid=120664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:17:13.083385 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-3104b60c-e069-450f-97f3-f158721319a6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "POST /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13/action" status: 200 len: 32 microversion: 2.1 time: 0.229526 Aug 28 10:17:13.084117 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 108/235] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Aug 28 10:17:12 2022] POST /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13/action => generated 32 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 28 10:17:13.095242 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-48960e3f-ca47-46af-82c5-f38ca1b5eba4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:13.096214 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-48960e3f-ca47-46af-82c5-f38ca1b5eba4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:13.104451 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48960e3f-ca47-46af-82c5-f38ca1b5eba4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:13.105113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48960e3f-ca47-46af-82c5-f38ca1b5eba4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:13.105542 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48960e3f-ca47-46af-82c5-f38ca1b5eba4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:13.106318 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48960e3f-ca47-46af-82c5-f38ca1b5eba4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:13.106773 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48960e3f-ca47-46af-82c5-f38ca1b5eba4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:13.107197 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48960e3f-ca47-46af-82c5-f38ca1b5eba4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:13.326930 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-48960e3f-ca47-46af-82c5-f38ca1b5eba4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:13.334731 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-48960e3f-ca47-46af-82c5-f38ca1b5eba4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.244572 Aug 28 10:17:13.335386 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 128/236] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:13 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:14.356444 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e2833a7e-6b3e-414d-8f28-7f1c793b70f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:14.357175 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e2833a7e-6b3e-414d-8f28-7f1c793b70f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:14.364085 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e2833a7e-6b3e-414d-8f28-7f1c793b70f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:14.364593 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e2833a7e-6b3e-414d-8f28-7f1c793b70f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:14.365026 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e2833a7e-6b3e-414d-8f28-7f1c793b70f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:14.365864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e2833a7e-6b3e-414d-8f28-7f1c793b70f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:14.366366 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e2833a7e-6b3e-414d-8f28-7f1c793b70f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:14.367108 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e2833a7e-6b3e-414d-8f28-7f1c793b70f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:14.521876 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-e2833a7e-6b3e-414d-8f28-7f1c793b70f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:14.534173 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-e2833a7e-6b3e-414d-8f28-7f1c793b70f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.182369 Aug 28 10:17:14.541518 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 109/237] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:14 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:15.556732 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1a08281b-49d5-4e67-b6d0-f1c53afac271 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:15.557345 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1a08281b-49d5-4e67-b6d0-f1c53afac271 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:15.559317 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=82 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:15.565793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a08281b-49d5-4e67-b6d0-f1c53afac271 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:15.566273 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a08281b-49d5-4e67-b6d0-f1c53afac271 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:15.566870 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a08281b-49d5-4e67-b6d0-f1c53afac271 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:15.567719 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a08281b-49d5-4e67-b6d0-f1c53afac271 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:15.568311 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a08281b-49d5-4e67-b6d0-f1c53afac271 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:15.568901 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a08281b-49d5-4e67-b6d0-f1c53afac271 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:15.740415 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1a08281b-49d5-4e67-b6d0-f1c53afac271 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:15.752342 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1a08281b-49d5-4e67-b6d0-f1c53afac271 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.199418 Aug 28 10:17:15.756398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 129/238] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:15 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:16.776807 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-34fe17c4-dffc-4dfd-b006-7078367af452 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:16.777589 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-34fe17c4-dffc-4dfd-b006-7078367af452 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:16.787468 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-34fe17c4-dffc-4dfd-b006-7078367af452 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:16.791770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-34fe17c4-dffc-4dfd-b006-7078367af452 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:16.792219 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-34fe17c4-dffc-4dfd-b006-7078367af452 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:16.792966 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-34fe17c4-dffc-4dfd-b006-7078367af452 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:16.793650 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-34fe17c4-dffc-4dfd-b006-7078367af452 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:16.794255 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-34fe17c4-dffc-4dfd-b006-7078367af452 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:17.043114 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-34fe17c4-dffc-4dfd-b006-7078367af452 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:17.060178 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-34fe17c4-dffc-4dfd-b006-7078367af452 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.288055 Aug 28 10:17:17.061244 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 110/239] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:16 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:18.081839 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-eefc286f-0e38-4fab-b067-a2702d9225c6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:18.082673 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-eefc286f-0e38-4fab-b067-a2702d9225c6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:18.091087 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eefc286f-0e38-4fab-b067-a2702d9225c6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:18.091676 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eefc286f-0e38-4fab-b067-a2702d9225c6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:18.092192 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eefc286f-0e38-4fab-b067-a2702d9225c6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:18.092947 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eefc286f-0e38-4fab-b067-a2702d9225c6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:18.093513 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eefc286f-0e38-4fab-b067-a2702d9225c6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:18.093955 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eefc286f-0e38-4fab-b067-a2702d9225c6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:18.249525 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-eefc286f-0e38-4fab-b067-a2702d9225c6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:18.259841 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-eefc286f-0e38-4fab-b067-a2702d9225c6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.181753 Aug 28 10:17:18.261037 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 130/240] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:18 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:19.281707 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-3761d08a-25a6-415a-9c56-1c277e7db922 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:19.282562 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-3761d08a-25a6-415a-9c56-1c277e7db922 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:19.289879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3761d08a-25a6-415a-9c56-1c277e7db922 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:19.290477 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3761d08a-25a6-415a-9c56-1c277e7db922 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:19.291004 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3761d08a-25a6-415a-9c56-1c277e7db922 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:19.291755 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3761d08a-25a6-415a-9c56-1c277e7db922 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:19.292422 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3761d08a-25a6-415a-9c56-1c277e7db922 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:19.292929 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3761d08a-25a6-415a-9c56-1c277e7db922 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:19.467950 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-3761d08a-25a6-415a-9c56-1c277e7db922 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:19.478622 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-3761d08a-25a6-415a-9c56-1c277e7db922 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.201250 Aug 28 10:17:19.479727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 111/241] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:19 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:20.501026 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c099bcad-3d27-4f68-bcea-574d6590f4e0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:20.501762 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c099bcad-3d27-4f68-bcea-574d6590f4e0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:20.509110 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c099bcad-3d27-4f68-bcea-574d6590f4e0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:20.509586 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c099bcad-3d27-4f68-bcea-574d6590f4e0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:20.510009 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c099bcad-3d27-4f68-bcea-574d6590f4e0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:20.510732 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c099bcad-3d27-4f68-bcea-574d6590f4e0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:20.511582 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c099bcad-3d27-4f68-bcea-574d6590f4e0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:20.511985 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c099bcad-3d27-4f68-bcea-574d6590f4e0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:20.654752 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c099bcad-3d27-4f68-bcea-574d6590f4e0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:20.662563 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c099bcad-3d27-4f68-bcea-574d6590f4e0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.165939 Aug 28 10:17:20.663129 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 131/242] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:20 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:21.577332 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-bf5a17a2-936e-476d-94e2-78a2b5944418 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:21.577885 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-bf5a17a2-936e-476d-94e2-78a2b5944418 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:21.584924 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-bf5a17a2-936e-476d-94e2-78a2b5944418 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:21.585695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-bf5a17a2-936e-476d-94e2-78a2b5944418 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:21.586307 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-bf5a17a2-936e-476d-94e2-78a2b5944418 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:21.587234 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-bf5a17a2-936e-476d-94e2-78a2b5944418 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:21.587834 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-bf5a17a2-936e-476d-94e2-78a2b5944418 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:21.588253 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-bf5a17a2-936e-476d-94e2-78a2b5944418 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:21.613248 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-bf5a17a2-936e-476d-94e2-78a2b5944418 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Going to try to terminate instance {{(pid=120664) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 28 10:17:21.685538 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-94f88d28-25a1-4457-82fe-c246892fa25e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:21.686204 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-94f88d28-25a1-4457-82fe-c246892fa25e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:21.692891 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-94f88d28-25a1-4457-82fe-c246892fa25e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:21.693492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-94f88d28-25a1-4457-82fe-c246892fa25e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:21.693807 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-94f88d28-25a1-4457-82fe-c246892fa25e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:21.694852 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-94f88d28-25a1-4457-82fe-c246892fa25e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:21.695303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-94f88d28-25a1-4457-82fe-c246892fa25e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:21.695721 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-94f88d28-25a1-4457-82fe-c246892fa25e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:21.723819 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-bf5a17a2-936e-476d-94e2-78a2b5944418 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "DELETE /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 204 len: 0 microversion: 2.1 time: 0.150053 Aug 28 10:17:21.724522 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 112/243] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:17:21 2022] DELETE /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 28 10:17:21.733748 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4a99e063-9bbe-4f0d-b0ba-b53060cf3f74 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:21.734473 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4a99e063-9bbe-4f0d-b0ba-b53060cf3f74 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:21.740878 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4a99e063-9bbe-4f0d-b0ba-b53060cf3f74 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:21.741433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4a99e063-9bbe-4f0d-b0ba-b53060cf3f74 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:21.741853 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4a99e063-9bbe-4f0d-b0ba-b53060cf3f74 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:21.742540 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4a99e063-9bbe-4f0d-b0ba-b53060cf3f74 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:21.743149 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4a99e063-9bbe-4f0d-b0ba-b53060cf3f74 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:21.743716 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4a99e063-9bbe-4f0d-b0ba-b53060cf3f74 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:21.926655 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-94f88d28-25a1-4457-82fe-c246892fa25e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:21.933631 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4a99e063-9bbe-4f0d-b0ba-b53060cf3f74 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:21.934669 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-94f88d28-25a1-4457-82fe-c246892fa25e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.253076 Aug 28 10:17:21.935401 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 132/244] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:21 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:21.943037 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4a99e063-9bbe-4f0d-b0ba-b53060cf3f74 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1552 microversion: 2.1 time: 0.214053 Aug 28 10:17:21.943787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 113/245] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:21 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1552 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:22.955778 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0653fd92-b1fa-45d0-a4a3-2f6d5869e8bc tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:22.956384 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0653fd92-b1fa-45d0-a4a3-2f6d5869e8bc tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:22.963184 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0653fd92-b1fa-45d0-a4a3-2f6d5869e8bc tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:22.963184 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0653fd92-b1fa-45d0-a4a3-2f6d5869e8bc tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:22.965450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0653fd92-b1fa-45d0-a4a3-2f6d5869e8bc tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:22.966167 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0653fd92-b1fa-45d0-a4a3-2f6d5869e8bc tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:22.966628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0653fd92-b1fa-45d0-a4a3-2f6d5869e8bc tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:22.967113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0653fd92-b1fa-45d0-a4a3-2f6d5869e8bc tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:22.985826 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-46f107f1-0b78-4985-9cbe-2a8d6fab648f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:22.986383 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-46f107f1-0b78-4985-9cbe-2a8d6fab648f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:22.999401 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46f107f1-0b78-4985-9cbe-2a8d6fab648f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:23.000350 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46f107f1-0b78-4985-9cbe-2a8d6fab648f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:23.000810 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46f107f1-0b78-4985-9cbe-2a8d6fab648f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:23.001513 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46f107f1-0b78-4985-9cbe-2a8d6fab648f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:23.001986 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46f107f1-0b78-4985-9cbe-2a8d6fab648f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:23.002402 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46f107f1-0b78-4985-9cbe-2a8d6fab648f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:23.183639 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0653fd92-b1fa-45d0-a4a3-2f6d5869e8bc tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:23.195181 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0653fd92-b1fa-45d0-a4a3-2f6d5869e8bc tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.243234 Aug 28 10:17:23.201030 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-46f107f1-0b78-4985-9cbe-2a8d6fab648f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:23.211130 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-46f107f1-0b78-4985-9cbe-2a8d6fab648f tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1552 microversion: 2.1 time: 0.246817 Aug 28 10:17:23.212036 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 114/246] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:22 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1552 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:17:23.213299 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 133/247] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:22 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:24.217681 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-aa71cba4-3bed-48f9-bb14-7b8ee1b04b6b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:24.219090 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-aa71cba4-3bed-48f9-bb14-7b8ee1b04b6b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:24.227029 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aa71cba4-3bed-48f9-bb14-7b8ee1b04b6b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:24.227673 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aa71cba4-3bed-48f9-bb14-7b8ee1b04b6b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:24.228286 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aa71cba4-3bed-48f9-bb14-7b8ee1b04b6b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:24.229221 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aa71cba4-3bed-48f9-bb14-7b8ee1b04b6b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:24.229819 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aa71cba4-3bed-48f9-bb14-7b8ee1b04b6b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:24.230389 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aa71cba4-3bed-48f9-bb14-7b8ee1b04b6b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:24.232227 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7f5710c6-6302-48b1-bbbd-8a04efd4f8c1 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:24.232848 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7f5710c6-6302-48b1-bbbd-8a04efd4f8c1 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:24.239319 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f5710c6-6302-48b1-bbbd-8a04efd4f8c1 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:24.240028 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f5710c6-6302-48b1-bbbd-8a04efd4f8c1 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:24.240456 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f5710c6-6302-48b1-bbbd-8a04efd4f8c1 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:24.241196 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f5710c6-6302-48b1-bbbd-8a04efd4f8c1 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:24.241686 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f5710c6-6302-48b1-bbbd-8a04efd4f8c1 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:24.242044 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f5710c6-6302-48b1-bbbd-8a04efd4f8c1 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:24.463206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-aa71cba4-3bed-48f9-bb14-7b8ee1b04b6b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:24.472071 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-aa71cba4-3bed-48f9-bb14-7b8ee1b04b6b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.259146 Aug 28 10:17:24.472945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 115/248] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:24 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:24.485745 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7f5710c6-6302-48b1-bbbd-8a04efd4f8c1 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:24.491024 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7f5710c6-6302-48b1-bbbd-8a04efd4f8c1 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1552 microversion: 2.1 time: 0.263537 Aug 28 10:17:24.491831 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 134/249] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:24 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1552 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:17:25.493276 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-833120a3-8b8e-4be0-a0d9-25e458c11dec tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:25.494041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-833120a3-8b8e-4be0-a0d9-25e458c11dec tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:25.500921 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-833120a3-8b8e-4be0-a0d9-25e458c11dec tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:25.501398 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-833120a3-8b8e-4be0-a0d9-25e458c11dec tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:25.501820 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-833120a3-8b8e-4be0-a0d9-25e458c11dec tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:25.502501 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-833120a3-8b8e-4be0-a0d9-25e458c11dec tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:25.502939 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-833120a3-8b8e-4be0-a0d9-25e458c11dec tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:25.503349 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-833120a3-8b8e-4be0-a0d9-25e458c11dec tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:25.520094 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e405a8c7-9139-4911-a89d-745d345c11c7 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:25.520724 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e405a8c7-9139-4911-a89d-745d345c11c7 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:25.526833 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e405a8c7-9139-4911-a89d-745d345c11c7 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:25.527424 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e405a8c7-9139-4911-a89d-745d345c11c7 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:25.528106 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e405a8c7-9139-4911-a89d-745d345c11c7 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:25.529051 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e405a8c7-9139-4911-a89d-745d345c11c7 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:25.529597 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e405a8c7-9139-4911-a89d-745d345c11c7 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:25.530108 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e405a8c7-9139-4911-a89d-745d345c11c7 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:25.647736 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e405a8c7-9139-4911-a89d-745d345c11c7 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:25.659278 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e405a8c7-9139-4911-a89d-745d345c11c7 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1510 microversion: 2.1 time: 0.142933 Aug 28 10:17:25.682403 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 135/250] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:25 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:17:25.688046 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-7dfb0e78-d0d3-4d91-9030-5763141058e3 req-182a2d97-b578-4237-9350-ab77c073a477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4", "name": "network-vif-deleted", "tag": "a3a7c610-6f76-4e40-86da-4aaffb9925dd"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:17:25.702040 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7dfb0e78-d0d3-4d91-9030-5763141058e3 req-182a2d97-b578-4237-9350-ab77c073a477 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:25.702653 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7dfb0e78-d0d3-4d91-9030-5763141058e3 req-182a2d97-b578-4237-9350-ab77c073a477 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:25.703079 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7dfb0e78-d0d3-4d91-9030-5763141058e3 req-182a2d97-b578-4237-9350-ab77c073a477 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:25.714906 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-7dfb0e78-d0d3-4d91-9030-5763141058e3 req-182a2d97-b578-4237-9350-ab77c073a477 service nova] Creating event network-vif-deleted:a3a7c610-6f76-4e40-86da-4aaffb9925dd for instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 on hv-cinder-85200 Aug 28 10:17:25.720581 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-7dfb0e78-d0d3-4d91-9030-5763141058e3 req-182a2d97-b578-4237-9350-ab77c073a477 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036559 Aug 28 10:17:25.721493 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 136/251] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:17:25.748571 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-833120a3-8b8e-4be0-a0d9-25e458c11dec tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:25.758656 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-833120a3-8b8e-4be0-a0d9-25e458c11dec tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.269210 Aug 28 10:17:25.759253 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 116/252] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:25 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:26.686067 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f4cbf801-4c88-4121-9287-3e78ecb4fa15 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:26.686763 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f4cbf801-4c88-4121-9287-3e78ecb4fa15 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:26.694184 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4cbf801-4c88-4121-9287-3e78ecb4fa15 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:26.694724 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4cbf801-4c88-4121-9287-3e78ecb4fa15 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:26.695153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4cbf801-4c88-4121-9287-3e78ecb4fa15 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:26.695911 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4cbf801-4c88-4121-9287-3e78ecb4fa15 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:26.696450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4cbf801-4c88-4121-9287-3e78ecb4fa15 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:26.696902 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4cbf801-4c88-4121-9287-3e78ecb4fa15 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:26.734936 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4cbf801-4c88-4121-9287-3e78ecb4fa15 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:26.735372 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4cbf801-4c88-4121-9287-3e78ecb4fa15 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:26.735793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4cbf801-4c88-4121-9287-3e78ecb4fa15 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:26.736246 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-f4cbf801-4c88-4121-9287-3e78ecb4fa15 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lazy-loading 'fault' on Instance uuid 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:17:26.780558 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f33a8565-2233-4518-b39a-a6f3e697af49 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:26.781788 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f33a8565-2233-4518-b39a-a6f3e697af49 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:26.789795 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f33a8565-2233-4518-b39a-a6f3e697af49 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:26.790613 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f33a8565-2233-4518-b39a-a6f3e697af49 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:26.791638 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f33a8565-2233-4518-b39a-a6f3e697af49 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:26.792581 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f33a8565-2233-4518-b39a-a6f3e697af49 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:26.793559 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f33a8565-2233-4518-b39a-a6f3e697af49 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:26.794520 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f33a8565-2233-4518-b39a-a6f3e697af49 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:26.813370 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f4cbf801-4c88-4121-9287-3e78ecb4fa15 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e2acbd72a42758f63535bac526248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186d5bdc9b84b4aaae07b15f7cf132f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:26.834842 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f4cbf801-4c88-4121-9287-3e78ecb4fa15 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 200 len: 1350 microversion: 2.1 time: 0.151593 Aug 28 10:17:26.835800 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 137/253] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:26 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 1350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:26.941472 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f33a8565-2233-4518-b39a-a6f3e697af49 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:26.949574 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f33a8565-2233-4518-b39a-a6f3e697af49 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.173832 Aug 28 10:17:26.950484 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 117/254] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:26 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:17:27.855883 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3793ba47-5cc2-427d-a8a1-dc76354529d9 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:27.856487 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3793ba47-5cc2-427d-a8a1-dc76354529d9 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:27.862993 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3793ba47-5cc2-427d-a8a1-dc76354529d9 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:27.863469 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3793ba47-5cc2-427d-a8a1-dc76354529d9 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:27.863888 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3793ba47-5cc2-427d-a8a1-dc76354529d9 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:27.864591 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3793ba47-5cc2-427d-a8a1-dc76354529d9 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:27.865032 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3793ba47-5cc2-427d-a8a1-dc76354529d9 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:27.865440 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3793ba47-5cc2-427d-a8a1-dc76354529d9 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:27.881218 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-3793ba47-5cc2-427d-a8a1-dc76354529d9 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] HTTP exception thrown: Instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 could not be found. Aug 28 10:17:27.886210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3793ba47-5cc2-427d-a8a1-dc76354529d9 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Request method failure captured: Aug 28 10:17:27.886210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 HTTP/1.1 Aug 28 10:17:27.886210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:17:27.886210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:17:27.886210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:17:27.886210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:17:27.886210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:17:27.886210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:17:27.886210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:17:27.886210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:17:27.886210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0Bd82tzlP5x8l2FEaTIoCV_SAdmmeRUhcVTpqprqdlO0UlvynS0-Ox7x2NqD8T4szw3Puv1-tA-MhCJu6XEWCxABGE33soMLl9bOyesoxfz4wvdCayKfyhG5pshGRoZY7NDjECn8gWkPMUyKCxt8jgjnYb4mC-I9YDplh8otGQ5DyU Aug 28 10:17:27.886210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:17:27.886210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:17:27.886210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:17:27.886210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:17:27.886210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:17:27.886210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:17:27.886210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: f186d5bdc9b84b4aaae07b15f7cf132f Aug 28 10:17:27.886210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-DeleteServersTestJSON-1980123303 Aug 28 10:17:27.886210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:17:27.886210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:17:27.887542 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f186d5bdc9b84b4aaae07b15f7cf132f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f186d5bdc9b84b4aaae07b15f7cf132f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f186d5bdc9b84b4aaae07b15f7cf132f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f186d5bdc9b84b4aaae07b15f7cf132f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:17:27.887542 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-DeleteServersTestJSON-1980123303 Aug 28 10:17:27.887542 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: f186d5bdc9b84b4aaae07b15f7cf132f Aug 28 10:17:27.887542 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-DeleteServersTestJSON-1980123303 Aug 28 10:17:27.887542 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-DeleteServersTestJSON-1980123303-project Aug 28 10:17:27.887542 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:17:27.887542 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:17:27.887542 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: d39e2acbd72a42758f63535bac526248 Aug 28 10:17:27.887542 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-DeleteServersTestJSON-1980123303-project Aug 28 10:17:27.887542 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: > Aug 28 10:17:27.887542 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 could not be found. Aug 28 10:17:27.887542 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4'} Aug 28 10:17:27.888412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:17:27.888412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:17:27.888412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:17:27.888412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:17:27.888412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:17:27.888412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:17:27.888412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:17:27.888412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:17:27.888412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:17:27.888412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:17:27.888412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 could not be found. Aug 28 10:17:27.888412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:17:27.888412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:17:27.888412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:17:27.888412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:17:27.888412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:17:27.888412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:17:27.888412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:17:27.888412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:17:27.888412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:17:27.889625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:17:27.889625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:17:27.889625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:17:27.889625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:17:27.889625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:17:27.889625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:17:27.889625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:17:27.889625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 could not be found. Aug 28 10:17:27.889625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:17:27.889625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:17:27.889625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:17:27.889625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:17:27.889625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:17:27.889625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:17:27.889625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:17:27.889625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:17:27.889625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 could not be found. Aug 28 10:17:27.889625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:17:27.890609 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3793ba47-5cc2-427d-a8a1-dc76354529d9 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Returning 404 to user: Instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:17:27.890609 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3793ba47-5cc2-427d-a8a1-dc76354529d9 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 404 len: 111 microversion: 2.1 time: 0.036258 Aug 28 10:17:27.890609 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 138/255] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:27 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:17:27.971221 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-2d9e848f-cac2-4666-a1ba-e1ae1255547f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:27.971826 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-2d9e848f-cac2-4666-a1ba-e1ae1255547f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:27.978544 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2d9e848f-cac2-4666-a1ba-e1ae1255547f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:27.979025 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2d9e848f-cac2-4666-a1ba-e1ae1255547f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:27.979674 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2d9e848f-cac2-4666-a1ba-e1ae1255547f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:27.980433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2d9e848f-cac2-4666-a1ba-e1ae1255547f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:27.980974 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2d9e848f-cac2-4666-a1ba-e1ae1255547f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:27.981392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2d9e848f-cac2-4666-a1ba-e1ae1255547f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:28.000747 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:28.011307 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-692651ff-ee43-405d-9b50-049d470a80f8 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:28.013518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-692651ff-ee43-405d-9b50-049d470a80f8 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:28.020251 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-692651ff-ee43-405d-9b50-049d470a80f8 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:28.020822 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-692651ff-ee43-405d-9b50-049d470a80f8 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:28.021470 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-692651ff-ee43-405d-9b50-049d470a80f8 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:28.022152 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-692651ff-ee43-405d-9b50-049d470a80f8 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:28.022630 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-692651ff-ee43-405d-9b50-049d470a80f8 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:28.023044 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-692651ff-ee43-405d-9b50-049d470a80f8 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:28.039542 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-692651ff-ee43-405d-9b50-049d470a80f8 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] HTTP exception thrown: Instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 could not be found. Aug 28 10:17:28.041759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-692651ff-ee43-405d-9b50-049d470a80f8 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Request method failure captured: Aug 28 10:17:28.041759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4/os-volume_attachments HTTP/1.1 Aug 28 10:17:28.041759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:17:28.041759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:17:28.041759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:17:28.041759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:17:28.041759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:17:28.041759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:17:28.041759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:17:28.041759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:17:28.041759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0Bd82tzlP5x8l2FEaTIoCV_SAdmmeRUhcVTpqprqdlO0UlvynS0-Ox7x2NqD8T4szw3Puv1-tA-MhCJu6XEWCxABGE33soMLl9bOyesoxfz4wvdCayKfyhG5pshGRoZY7NDjECn8gWkPMUyKCxt8jgjnYb4mC-I9YDplh8otGQ5DyU Aug 28 10:17:28.041759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:17:28.041759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:17:28.041759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:17:28.041759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:17:28.041759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:17:28.041759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:17:28.041759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: f186d5bdc9b84b4aaae07b15f7cf132f Aug 28 10:17:28.041759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-DeleteServersTestJSON-1980123303 Aug 28 10:17:28.041759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:17:28.041759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:17:28.042904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f186d5bdc9b84b4aaae07b15f7cf132f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f186d5bdc9b84b4aaae07b15f7cf132f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f186d5bdc9b84b4aaae07b15f7cf132f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f186d5bdc9b84b4aaae07b15f7cf132f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:17:28.042904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-DeleteServersTestJSON-1980123303 Aug 28 10:17:28.042904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: f186d5bdc9b84b4aaae07b15f7cf132f Aug 28 10:17:28.042904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-DeleteServersTestJSON-1980123303 Aug 28 10:17:28.042904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-DeleteServersTestJSON-1980123303-project Aug 28 10:17:28.042904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:17:28.042904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:17:28.042904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: d39e2acbd72a42758f63535bac526248 Aug 28 10:17:28.042904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-DeleteServersTestJSON-1980123303-project Aug 28 10:17:28.042904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: > Aug 28 10:17:28.042904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 could not be found. Aug 28 10:17:28.042904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'server_id': '42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4'} Aug 28 10:17:28.043543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:17:28.043543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:17:28.043543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:17:28.043543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:17:28.043543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:17:28.043543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:17:28.043543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:17:28.043543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:17:28.043543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:17:28.043543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:17:28.043543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 could not be found. Aug 28 10:17:28.043543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:17:28.043543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:17:28.043543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:17:28.043543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:17:28.043543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:17:28.043543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:17:28.043543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:17:28.043543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:17:28.043543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:17:28.044618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:17:28.044618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 28 10:17:28.044618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 28 10:17:28.044618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 28 10:17:28.044618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 28 10:17:28.044618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 28 10:17:28.044618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 28 10:17:28.044618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:17:28.044618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:17:28.044618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 could not be found. Aug 28 10:17:28.044618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:17:28.044618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:17:28.044618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:17:28.044618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:17:28.044618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:17:28.044618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:17:28.044618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:17:28.044618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:17:28.044618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 could not be found. Aug 28 10:17:28.044618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:17:28.047260 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-692651ff-ee43-405d-9b50-049d470a80f8 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Returning 404 to user: Instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:17:28.048257 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-692651ff-ee43-405d-9b50-049d470a80f8 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041107 Aug 28 10:17:28.049362 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 139/256] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Aug 28 10:17:28 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 28 10:17:28.171079 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-2d9e848f-cac2-4666-a1ba-e1ae1255547f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:28.179489 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-2d9e848f-cac2-4666-a1ba-e1ae1255547f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.212348 Aug 28 10:17:28.180131 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 118/257] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:27 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:29.200569 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-140be244-9068-4a33-bffa-036d7c277db6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:29.201106 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-140be244-9068-4a33-bffa-036d7c277db6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:29.208434 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-140be244-9068-4a33-bffa-036d7c277db6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:29.208434 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-140be244-9068-4a33-bffa-036d7c277db6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:29.209068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-140be244-9068-4a33-bffa-036d7c277db6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:29.209785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-140be244-9068-4a33-bffa-036d7c277db6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:29.210224 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-140be244-9068-4a33-bffa-036d7c277db6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:29.210611 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-140be244-9068-4a33-bffa-036d7c277db6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:29.215903 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:29.346662 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-140be244-9068-4a33-bffa-036d7c277db6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:29.360628 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-be55c158-cf1e-4f9c-acb1-8a19303c1ac8 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:29.361117 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-be55c158-cf1e-4f9c-acb1-8a19303c1ac8 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:29.368787 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-140be244-9068-4a33-bffa-036d7c277db6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.172028 Aug 28 10:17:29.369377 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 140/258] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:29 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:29.372640 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-be55c158-cf1e-4f9c-acb1-8a19303c1ac8 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:29.373127 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-be55c158-cf1e-4f9c-acb1-8a19303c1ac8 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:29.373555 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-be55c158-cf1e-4f9c-acb1-8a19303c1ac8 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:29.374254 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-be55c158-cf1e-4f9c-acb1-8a19303c1ac8 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:29.374700 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-be55c158-cf1e-4f9c-acb1-8a19303c1ac8 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:29.375129 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-be55c158-cf1e-4f9c-acb1-8a19303c1ac8 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:29.389411 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-be55c158-cf1e-4f9c-acb1-8a19303c1ac8 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] HTTP exception thrown: Instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 could not be found. Aug 28 10:17:29.394059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-be55c158-cf1e-4f9c-acb1-8a19303c1ac8 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Request method failure captured: Aug 28 10:17:29.394059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: DELETE /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 HTTP/1.1 Aug 28 10:17:29.394059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:17:29.394059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:17:29.394059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:17:29.394059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:17:29.394059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:17:29.394059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:17:29.394059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:17:29.394059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:17:29.394059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0Bd82tzlP5x8l2FEaTIoCV_SAdmmeRUhcVTpqprqdlO0UlvynS0-Ox7x2NqD8T4szw3Puv1-tA-MhCJu6XEWCxABGE33soMLl9bOyesoxfz4wvdCayKfyhG5pshGRoZY7NDjECn8gWkPMUyKCxt8jgjnYb4mC-I9YDplh8otGQ5DyU Aug 28 10:17:29.394059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:17:29.394059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:17:29.394059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:17:29.394059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:17:29.394059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:17:29.394059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:17:29.394059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: f186d5bdc9b84b4aaae07b15f7cf132f Aug 28 10:17:29.394059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-DeleteServersTestJSON-1980123303 Aug 28 10:17:29.394059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:17:29.394059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:17:29.395429 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f186d5bdc9b84b4aaae07b15f7cf132f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f186d5bdc9b84b4aaae07b15f7cf132f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f186d5bdc9b84b4aaae07b15f7cf132f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f186d5bdc9b84b4aaae07b15f7cf132f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:17:29.395429 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-DeleteServersTestJSON-1980123303 Aug 28 10:17:29.395429 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: f186d5bdc9b84b4aaae07b15f7cf132f Aug 28 10:17:29.395429 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-DeleteServersTestJSON-1980123303 Aug 28 10:17:29.395429 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-DeleteServersTestJSON-1980123303-project Aug 28 10:17:29.395429 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:17:29.395429 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:17:29.395429 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: d39e2acbd72a42758f63535bac526248 Aug 28 10:17:29.395429 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-DeleteServersTestJSON-1980123303-project Aug 28 10:17:29.395429 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: > Aug 28 10:17:29.395429 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 could not be found. Aug 28 10:17:29.395429 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': '42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4'} Aug 28 10:17:29.396214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:17:29.396214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:17:29.396214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:17:29.396214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:17:29.396214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:17:29.396214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:17:29.396214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:17:29.396214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:17:29.396214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:17:29.396214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:17:29.396214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 could not be found. Aug 28 10:17:29.396214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:17:29.396214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:17:29.396214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:17:29.396214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:17:29.396214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:17:29.396214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:17:29.396214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:17:29.396214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:17:29.396214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:17:29.397376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:17:29.397376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 28 10:17:29.397376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 28 10:17:29.397376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 28 10:17:29.397376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 28 10:17:29.397376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:17:29.397376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:17:29.397376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:17:29.397376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:17:29.397376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 could not be found. Aug 28 10:17:29.397376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:17:29.397376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:17:29.397376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:17:29.397376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:17:29.397376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:17:29.397376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:17:29.397376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:17:29.397376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:17:29.397376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 could not be found. Aug 28 10:17:29.397376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:17:29.398396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-be55c158-cf1e-4f9c-acb1-8a19303c1ac8 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Returning 404 to user: Instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:17:29.398396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-be55c158-cf1e-4f9c-acb1-8a19303c1ac8 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "DELETE /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 404 len: 111 microversion: 2.1 time: 0.038804 Aug 28 10:17:29.398396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 119/259] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:17:29 2022] DELETE /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:17:29.404396 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7fd73b63-bdea-4fc8-9131-ec5fca78fd65 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:29.405082 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7fd73b63-bdea-4fc8-9131-ec5fca78fd65 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] [instance: 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:29.411086 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7fd73b63-bdea-4fc8-9131-ec5fca78fd65 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:29.411555 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7fd73b63-bdea-4fc8-9131-ec5fca78fd65 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:29.411971 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7fd73b63-bdea-4fc8-9131-ec5fca78fd65 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:29.412675 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7fd73b63-bdea-4fc8-9131-ec5fca78fd65 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:29.413112 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7fd73b63-bdea-4fc8-9131-ec5fca78fd65 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:29.413765 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7fd73b63-bdea-4fc8-9131-ec5fca78fd65 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:29.427338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-7fd73b63-bdea-4fc8-9131-ec5fca78fd65 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] HTTP exception thrown: Instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 could not be found. Aug 28 10:17:29.429240 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7fd73b63-bdea-4fc8-9131-ec5fca78fd65 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Request method failure captured: Aug 28 10:17:29.429240 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 HTTP/1.1 Aug 28 10:17:29.429240 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:17:29.429240 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:17:29.429240 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:17:29.429240 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:17:29.429240 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:17:29.429240 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:17:29.429240 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:17:29.429240 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:17:29.429240 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0Bd82tzlP5x8l2FEaTIoCV_SAdmmeRUhcVTpqprqdlO0UlvynS0-Ox7x2NqD8T4szw3Puv1-tA-MhCJu6XEWCxABGE33soMLl9bOyesoxfz4wvdCayKfyhG5pshGRoZY7NDjECn8gWkPMUyKCxt8jgjnYb4mC-I9YDplh8otGQ5DyU Aug 28 10:17:29.429240 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:17:29.429240 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:17:29.429240 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:17:29.429240 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:17:29.429240 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:17:29.429240 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:17:29.429240 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: f186d5bdc9b84b4aaae07b15f7cf132f Aug 28 10:17:29.429240 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-DeleteServersTestJSON-1980123303 Aug 28 10:17:29.429240 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:17:29.429240 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:17:29.430766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f186d5bdc9b84b4aaae07b15f7cf132f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f186d5bdc9b84b4aaae07b15f7cf132f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f186d5bdc9b84b4aaae07b15f7cf132f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f186d5bdc9b84b4aaae07b15f7cf132f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:17:29.430766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-DeleteServersTestJSON-1980123303 Aug 28 10:17:29.430766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: f186d5bdc9b84b4aaae07b15f7cf132f Aug 28 10:17:29.430766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-DeleteServersTestJSON-1980123303 Aug 28 10:17:29.430766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-DeleteServersTestJSON-1980123303-project Aug 28 10:17:29.430766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:17:29.430766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:17:29.430766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: d39e2acbd72a42758f63535bac526248 Aug 28 10:17:29.430766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-DeleteServersTestJSON-1980123303-project Aug 28 10:17:29.430766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: > Aug 28 10:17:29.430766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 could not be found. Aug 28 10:17:29.430766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4'} Aug 28 10:17:29.431450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:17:29.431450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:17:29.431450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:17:29.431450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:17:29.431450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:17:29.431450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:17:29.431450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:17:29.431450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:17:29.431450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:17:29.431450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:17:29.431450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 could not be found. Aug 28 10:17:29.431450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:17:29.431450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:17:29.431450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:17:29.431450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:17:29.431450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:17:29.431450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:17:29.431450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:17:29.431450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:17:29.431450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:17:29.432471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:17:29.432471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:17:29.432471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:17:29.432471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:17:29.432471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:17:29.432471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:17:29.432471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:17:29.432471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 could not be found. Aug 28 10:17:29.432471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:17:29.432471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:17:29.432471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:17:29.432471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:17:29.432471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:17:29.432471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:17:29.432471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:17:29.432471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:17:29.432471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 could not be found. Aug 28 10:17:29.432471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:17:29.433438 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7fd73b63-bdea-4fc8-9131-ec5fca78fd65 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] Returning 404 to user: Instance 42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:17:29.433438 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7fd73b63-bdea-4fc8-9131-ec5fca78fd65 tempest-DeleteServersTestJSON-1980123303 tempest-DeleteServersTestJSON-1980123303-project] 10.222.0.40 "GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4" status: 404 len: 111 microversion: 2.1 time: 0.030542 Aug 28 10:17:29.433438 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 141/260] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:29 2022] GET /compute/v2.1/servers/42fdd760-9d9a-4f8b-b37f-6224dc8b1bc4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:17:30.390889 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-a1fee706-3b84-42b8-b406-cf96203f220a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:30.392268 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-a1fee706-3b84-42b8-b406-cf96203f220a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:30.400056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a1fee706-3b84-42b8-b406-cf96203f220a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:30.400657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a1fee706-3b84-42b8-b406-cf96203f220a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:30.401288 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a1fee706-3b84-42b8-b406-cf96203f220a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:30.402048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a1fee706-3b84-42b8-b406-cf96203f220a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:30.402717 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a1fee706-3b84-42b8-b406-cf96203f220a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:30.403344 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a1fee706-3b84-42b8-b406-cf96203f220a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:30.634765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-a1fee706-3b84-42b8-b406-cf96203f220a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:30.646014 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-a1fee706-3b84-42b8-b406-cf96203f220a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.259166 Aug 28 10:17:30.664838 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 120/261] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:30 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:31.676926 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fc40e52d-e2b5-409c-b0ed-6ff5d33671a0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:31.677519 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fc40e52d-e2b5-409c-b0ed-6ff5d33671a0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:31.690430 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fc40e52d-e2b5-409c-b0ed-6ff5d33671a0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:31.691144 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fc40e52d-e2b5-409c-b0ed-6ff5d33671a0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:31.691750 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fc40e52d-e2b5-409c-b0ed-6ff5d33671a0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:31.693083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fc40e52d-e2b5-409c-b0ed-6ff5d33671a0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:31.694329 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fc40e52d-e2b5-409c-b0ed-6ff5d33671a0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:31.694946 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fc40e52d-e2b5-409c-b0ed-6ff5d33671a0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:31.936703 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fc40e52d-e2b5-409c-b0ed-6ff5d33671a0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:31.950859 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fc40e52d-e2b5-409c-b0ed-6ff5d33671a0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.281889 Aug 28 10:17:31.951743 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 142/262] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:31 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:32.971287 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-3f322878-f512-4138-bc6d-ccaed7e2b901 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:32.971905 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-3f322878-f512-4138-bc6d-ccaed7e2b901 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:32.978999 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3f322878-f512-4138-bc6d-ccaed7e2b901 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:32.979470 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3f322878-f512-4138-bc6d-ccaed7e2b901 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:32.980315 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3f322878-f512-4138-bc6d-ccaed7e2b901 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:32.981312 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3f322878-f512-4138-bc6d-ccaed7e2b901 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:32.982037 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3f322878-f512-4138-bc6d-ccaed7e2b901 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:32.982694 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3f322878-f512-4138-bc6d-ccaed7e2b901 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:33.194299 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-3f322878-f512-4138-bc6d-ccaed7e2b901 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:33.213148 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-3f322878-f512-4138-bc6d-ccaed7e2b901 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.245615 Aug 28 10:17:33.224382 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 121/263] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:32 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:34.236565 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-954c5825-c6d7-4984-9e34-0bf2b07c57a2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:34.237721 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-954c5825-c6d7-4984-9e34-0bf2b07c57a2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:34.244543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-954c5825-c6d7-4984-9e34-0bf2b07c57a2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:34.245086 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-954c5825-c6d7-4984-9e34-0bf2b07c57a2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:34.245627 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-954c5825-c6d7-4984-9e34-0bf2b07c57a2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:34.246395 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-954c5825-c6d7-4984-9e34-0bf2b07c57a2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:34.246836 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-954c5825-c6d7-4984-9e34-0bf2b07c57a2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:34.247242 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-954c5825-c6d7-4984-9e34-0bf2b07c57a2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:34.389791 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-954c5825-c6d7-4984-9e34-0bf2b07c57a2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:34.399620 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-954c5825-c6d7-4984-9e34-0bf2b07c57a2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.167142 Aug 28 10:17:34.413163 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 143/264] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:34 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:35.422155 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c3bf10c7-a7a9-4fde-969c-7899a13244ba tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:35.423785 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c3bf10c7-a7a9-4fde-969c-7899a13244ba tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:35.438819 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c3bf10c7-a7a9-4fde-969c-7899a13244ba tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:35.441938 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c3bf10c7-a7a9-4fde-969c-7899a13244ba tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:35.443413 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c3bf10c7-a7a9-4fde-969c-7899a13244ba tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:35.444399 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c3bf10c7-a7a9-4fde-969c-7899a13244ba tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:35.447793 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c3bf10c7-a7a9-4fde-969c-7899a13244ba tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:35.448377 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c3bf10c7-a7a9-4fde-969c-7899a13244ba tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:35.678335 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c3bf10c7-a7a9-4fde-969c-7899a13244ba tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:35.701490 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c3bf10c7-a7a9-4fde-969c-7899a13244ba tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.280507 Aug 28 10:17:35.714365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 122/265] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:35 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:36.722719 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e20b7c23-817e-4ace-ab3c-770c67fead0a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:36.723308 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e20b7c23-817e-4ace-ab3c-770c67fead0a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:36.737735 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e20b7c23-817e-4ace-ab3c-770c67fead0a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:36.738252 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e20b7c23-817e-4ace-ab3c-770c67fead0a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:36.738640 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e20b7c23-817e-4ace-ab3c-770c67fead0a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:36.739336 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e20b7c23-817e-4ace-ab3c-770c67fead0a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:36.739780 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e20b7c23-817e-4ace-ab3c-770c67fead0a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:36.740190 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e20b7c23-817e-4ace-ab3c-770c67fead0a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:37.046582 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e20b7c23-817e-4ace-ab3c-770c67fead0a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:37.056275 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e20b7c23-817e-4ace-ab3c-770c67fead0a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.337962 Aug 28 10:17:37.057839 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 144/266] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:36 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:38.079623 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e9150137-5bc2-4ce8-8d02-d2b6d3aee626 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:38.080901 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e9150137-5bc2-4ce8-8d02-d2b6d3aee626 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:38.089558 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e9150137-5bc2-4ce8-8d02-d2b6d3aee626 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:38.093947 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e9150137-5bc2-4ce8-8d02-d2b6d3aee626 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:38.094675 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e9150137-5bc2-4ce8-8d02-d2b6d3aee626 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:38.100247 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e9150137-5bc2-4ce8-8d02-d2b6d3aee626 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:38.100975 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e9150137-5bc2-4ce8-8d02-d2b6d3aee626 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:38.101566 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e9150137-5bc2-4ce8-8d02-d2b6d3aee626 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:38.352593 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-e9150137-5bc2-4ce8-8d02-d2b6d3aee626 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:38.365284 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-e9150137-5bc2-4ce8-8d02-d2b6d3aee626 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.290152 Aug 28 10:17:38.377938 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 123/267] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:38 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:39.388355 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6a1ade97-6a9c-4355-8890-fb641753be79 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:39.389051 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6a1ade97-6a9c-4355-8890-fb641753be79 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:39.400290 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a1ade97-6a9c-4355-8890-fb641753be79 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:39.403062 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a1ade97-6a9c-4355-8890-fb641753be79 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:39.403506 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a1ade97-6a9c-4355-8890-fb641753be79 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:39.407522 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a1ade97-6a9c-4355-8890-fb641753be79 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:39.408000 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a1ade97-6a9c-4355-8890-fb641753be79 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:39.411068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a1ade97-6a9c-4355-8890-fb641753be79 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:39.686043 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6a1ade97-6a9c-4355-8890-fb641753be79 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:39.702487 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6a1ade97-6a9c-4355-8890-fb641753be79 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.319340 Aug 28 10:17:39.704086 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 145/268] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:39 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:40.432276 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e34ca5b3-9754-43c2-8ab5-60757e1b205e tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Action: 'create', calling method: .version_select at 0x7f7a1c3655e0>, body: {"keypair": {"name": "tempest-keypair-315272580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVaY7N1mxkXqDYwdQLoU/45vWAsjTFCmaleEkYNiKHMTY1oErGx1S62PQMLzXEZs6Q3DdpAOJw6Cbf5t3uw+ROjR49Bcgtyfkju9523SmauS0l+Y7FIeeQ/6sRNymHbSA=="}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:17:40.437824 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:40.468317 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-e34ca5b3-9754-43c2-8ab5-60757e1b205e tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Getting quotas for project 0e47be8f2ac14c19ab40e293422c845d. Resources: {'key_pairs'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:17:40.473831 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-e34ca5b3-9754-43c2-8ab5-60757e1b205e tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Getting quotas for user 38a331e431394e4882f31afd31f16d46 and project 0e47be8f2ac14c19ab40e293422c845d. Resources: {'key_pairs'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:17:40.506843 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-e34ca5b3-9754-43c2-8ab5-60757e1b205e tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.236046 Aug 28 10:17:40.507791 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 124/269] 10.222.0.40 () {60 vars in 1159 bytes} [Sun Aug 28 10:17:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:17:40.723720 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-620dc1b5-585f-47a4-8224-097864fcca43 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:40.724388 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-620dc1b5-585f-47a4-8224-097864fcca43 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:40.734744 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-620dc1b5-585f-47a4-8224-097864fcca43 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:40.735229 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-620dc1b5-585f-47a4-8224-097864fcca43 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:40.735645 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-620dc1b5-585f-47a4-8224-097864fcca43 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:40.736336 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-620dc1b5-585f-47a4-8224-097864fcca43 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:40.741174 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-620dc1b5-585f-47a4-8224-097864fcca43 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:40.743249 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-620dc1b5-585f-47a4-8224-097864fcca43 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:40.973237 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-620dc1b5-585f-47a4-8224-097864fcca43 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:40.988570 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-620dc1b5-585f-47a4-8224-097864fcca43 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.268825 Aug 28 10:17:40.991540 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 146/270] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:40 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:42.011951 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c92a528d-e0e5-4850-a723-0cdcab027c38 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:42.013241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c92a528d-e0e5-4850-a723-0cdcab027c38 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:42.024081 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c92a528d-e0e5-4850-a723-0cdcab027c38 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:42.024341 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c92a528d-e0e5-4850-a723-0cdcab027c38 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:42.024823 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c92a528d-e0e5-4850-a723-0cdcab027c38 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:42.025767 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c92a528d-e0e5-4850-a723-0cdcab027c38 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:42.026398 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c92a528d-e0e5-4850-a723-0cdcab027c38 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:42.027001 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c92a528d-e0e5-4850-a723-0cdcab027c38 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:42.271110 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c92a528d-e0e5-4850-a723-0cdcab027c38 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:42.280228 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c92a528d-e0e5-4850-a723-0cdcab027c38 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.272689 Aug 28 10:17:42.280916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 125/271] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:42 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:42.382781 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9e2e5033-a749-461c-a939-5dd9d1ef0073 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1891852114", "imageRef": "2780c39b-8bd3-4e73-9669-2b2e29474f3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6f7c423-22b6-4b3c-a83a-6484427a242a"}], "security_groups": [{"name": "tempest-securitygroup--938113428"}], "key_name": "tempest-keypair-315272580", "user_data": "}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:17:42.484555 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-9e2e5033-a749-461c-a939-5dd9d1ef0073 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] validate_networks() for [('d6f7c423-22b6-4b3c-a83a-6484427a242a', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 28 10:17:42.967546 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-9e2e5033-a749-461c-a939-5dd9d1ef0073 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 28 10:17:42.967992 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-9e2e5033-a749-461c-a939-5dd9d1ef0073 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 28 10:17:42.968821 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-9e2e5033-a749-461c-a939-5dd9d1ef0073 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 28 10:17:42.969225 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-9e2e5033-a749-461c-a939-5dd9d1ef0073 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 28 10:17:42.969628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-9e2e5033-a749-461c-a939-5dd9d1ef0073 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 28 10:17:42.979427 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e2e5033-a749-461c-a939-5dd9d1ef0073 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:42.979952 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e2e5033-a749-461c-a939-5dd9d1ef0073 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:42.980435 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e2e5033-a749-461c-a939-5dd9d1ef0073 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:42.981103 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e2e5033-a749-461c-a939-5dd9d1ef0073 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:42.992220 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e2e5033-a749-461c-a939-5dd9d1ef0073 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:42.992220 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e2e5033-a749-461c-a939-5dd9d1ef0073 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:43.001976 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-9e2e5033-a749-461c-a939-5dd9d1ef0073 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Getting quotas for project 0e47be8f2ac14c19ab40e293422c845d. Resources: {'instances', 'cores', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:17:43.006502 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-9e2e5033-a749-461c-a939-5dd9d1ef0073 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Getting quotas for user 38a331e431394e4882f31afd31f16d46 and project 0e47be8f2ac14c19ab40e293422c845d. Resources: {'instances', 'cores', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:17:43.020705 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9e2e5033-a749-461c-a939-5dd9d1ef0073 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 28 10:17:43.023978 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9e2e5033-a749-461c-a939-5dd9d1ef0073 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2780c39b-8bd3-4e73-9669-2b2e29474f3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 28 10:17:43.075434 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9e2e5033-a749-461c-a939-5dd9d1ef0073 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.694562 Aug 28 10:17:43.075434 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 147/272] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Aug 28 10:17:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 28 10:17:43.084945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-cc724979-8991-4cbc-9973-d502ef4ccffd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:43.085549 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-cc724979-8991-4cbc-9973-d502ef4ccffd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:43.167974 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-cc724979-8991-4cbc-9973-d502ef4ccffd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:43.182159 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-cc724979-8991-4cbc-9973-d502ef4ccffd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1237 microversion: 2.1 time: 0.101103 Aug 28 10:17:43.183429 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 126/273] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:43 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1237 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:43.301689 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a71c56f6-8342-4117-8139-84ed51377b30 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:43.302977 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a71c56f6-8342-4117-8139-84ed51377b30 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:43.313639 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a71c56f6-8342-4117-8139-84ed51377b30 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:43.314373 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a71c56f6-8342-4117-8139-84ed51377b30 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:43.315127 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a71c56f6-8342-4117-8139-84ed51377b30 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:43.315972 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a71c56f6-8342-4117-8139-84ed51377b30 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:43.316689 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a71c56f6-8342-4117-8139-84ed51377b30 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:43.317307 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a71c56f6-8342-4117-8139-84ed51377b30 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:43.474477 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a71c56f6-8342-4117-8139-84ed51377b30 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:43.486870 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a71c56f6-8342-4117-8139-84ed51377b30 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.189428 Aug 28 10:17:43.487902 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 148/274] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:43 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:44.204051 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-d1238350-b16a-438a-b47f-a726d9966835 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:44.204695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-d1238350-b16a-438a-b47f-a726d9966835 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:44.212176 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d1238350-b16a-438a-b47f-a726d9966835 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:44.212688 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d1238350-b16a-438a-b47f-a726d9966835 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:44.213123 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d1238350-b16a-438a-b47f-a726d9966835 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:44.213818 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d1238350-b16a-438a-b47f-a726d9966835 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:44.214273 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d1238350-b16a-438a-b47f-a726d9966835 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:44.214696 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d1238350-b16a-438a-b47f-a726d9966835 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:44.276459 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d1238350-b16a-438a-b47f-a726d9966835 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:44.284370 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-d1238350-b16a-438a-b47f-a726d9966835 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1241 microversion: 2.1 time: 0.084989 Aug 28 10:17:44.287760 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 127/275] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:44 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:44.507303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-565d4448-7834-4542-9338-082af74f9a69 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:44.508043 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-565d4448-7834-4542-9338-082af74f9a69 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:44.514455 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-565d4448-7834-4542-9338-082af74f9a69 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:44.514938 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-565d4448-7834-4542-9338-082af74f9a69 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:44.515300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-565d4448-7834-4542-9338-082af74f9a69 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:44.515960 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-565d4448-7834-4542-9338-082af74f9a69 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:44.516413 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-565d4448-7834-4542-9338-082af74f9a69 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:44.516864 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-565d4448-7834-4542-9338-082af74f9a69 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:44.647360 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-565d4448-7834-4542-9338-082af74f9a69 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:44.655451 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-565d4448-7834-4542-9338-082af74f9a69 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.152066 Aug 28 10:17:44.656026 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 149/276] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:44 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:45.305300 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-2e110760-95fb-4b05-8c5f-a8a2621c833f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:45.305906 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-2e110760-95fb-4b05-8c5f-a8a2621c833f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:45.312938 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2e110760-95fb-4b05-8c5f-a8a2621c833f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:45.313404 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2e110760-95fb-4b05-8c5f-a8a2621c833f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:45.314034 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2e110760-95fb-4b05-8c5f-a8a2621c833f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:45.314706 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2e110760-95fb-4b05-8c5f-a8a2621c833f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:45.315321 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2e110760-95fb-4b05-8c5f-a8a2621c833f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:45.315718 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2e110760-95fb-4b05-8c5f-a8a2621c833f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:45.375949 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-2e110760-95fb-4b05-8c5f-a8a2621c833f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:45.383863 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-2e110760-95fb-4b05-8c5f-a8a2621c833f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1241 microversion: 2.1 time: 0.082471 Aug 28 10:17:45.384431 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 128/277] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:45 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:45.681113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-14954b49-3677-4ed4-9967-3db5948fe1f0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:45.682082 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-14954b49-3677-4ed4-9967-3db5948fe1f0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:45.684979 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:45.693713 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-14954b49-3677-4ed4-9967-3db5948fe1f0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:45.694491 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-14954b49-3677-4ed4-9967-3db5948fe1f0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:45.695182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-14954b49-3677-4ed4-9967-3db5948fe1f0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:45.696286 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-14954b49-3677-4ed4-9967-3db5948fe1f0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:45.697055 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-14954b49-3677-4ed4-9967-3db5948fe1f0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:45.697736 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-14954b49-3677-4ed4-9967-3db5948fe1f0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:45.831668 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-14954b49-3677-4ed4-9967-3db5948fe1f0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:45.843598 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-14954b49-3677-4ed4-9967-3db5948fe1f0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.169005 Aug 28 10:17:45.844425 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 150/278] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:45 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:46.404591 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-886d10c7-65fb-4f68-8eb9-e07140ec7601 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:46.405198 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-886d10c7-65fb-4f68-8eb9-e07140ec7601 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:46.411746 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-886d10c7-65fb-4f68-8eb9-e07140ec7601 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:46.412223 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-886d10c7-65fb-4f68-8eb9-e07140ec7601 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:46.412684 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-886d10c7-65fb-4f68-8eb9-e07140ec7601 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:46.413370 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-886d10c7-65fb-4f68-8eb9-e07140ec7601 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:46.413817 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-886d10c7-65fb-4f68-8eb9-e07140ec7601 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:46.414644 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-886d10c7-65fb-4f68-8eb9-e07140ec7601 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:46.476491 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-886d10c7-65fb-4f68-8eb9-e07140ec7601 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:46.484878 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-886d10c7-65fb-4f68-8eb9-e07140ec7601 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1241 microversion: 2.1 time: 0.084150 Aug 28 10:17:46.485453 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 129/279] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:46 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:46.874115 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9fe7ee26-b8ae-4b11-84fd-70ba8db8fdf6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:46.874825 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9fe7ee26-b8ae-4b11-84fd-70ba8db8fdf6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:46.883633 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9fe7ee26-b8ae-4b11-84fd-70ba8db8fdf6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:46.884198 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9fe7ee26-b8ae-4b11-84fd-70ba8db8fdf6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:46.884741 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9fe7ee26-b8ae-4b11-84fd-70ba8db8fdf6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:46.885551 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9fe7ee26-b8ae-4b11-84fd-70ba8db8fdf6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:46.886077 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9fe7ee26-b8ae-4b11-84fd-70ba8db8fdf6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:46.886568 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9fe7ee26-b8ae-4b11-84fd-70ba8db8fdf6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:47.019366 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9fe7ee26-b8ae-4b11-84fd-70ba8db8fdf6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:47.027296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9fe7ee26-b8ae-4b11-84fd-70ba8db8fdf6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.159627 Aug 28 10:17:47.027885 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 151/280] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:46 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:47.509439 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4111e3ce-469d-48d7-a09b-937169d5d219 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:47.510432 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4111e3ce-469d-48d7-a09b-937169d5d219 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:47.521585 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4111e3ce-469d-48d7-a09b-937169d5d219 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:47.522398 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4111e3ce-469d-48d7-a09b-937169d5d219 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:47.523076 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4111e3ce-469d-48d7-a09b-937169d5d219 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:47.524192 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4111e3ce-469d-48d7-a09b-937169d5d219 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:47.524972 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4111e3ce-469d-48d7-a09b-937169d5d219 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:47.525697 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4111e3ce-469d-48d7-a09b-937169d5d219 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:47.589504 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4111e3ce-469d-48d7-a09b-937169d5d219 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:47.597558 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4111e3ce-469d-48d7-a09b-937169d5d219 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1241 microversion: 2.1 time: 0.094761 Aug 28 10:17:47.598128 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 130/281] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:47 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:48.052425 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-249eb9f8-ad45-4eda-b7f2-ff90545da102 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:48.053439 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-249eb9f8-ad45-4eda-b7f2-ff90545da102 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:48.063389 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-249eb9f8-ad45-4eda-b7f2-ff90545da102 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:48.064168 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-249eb9f8-ad45-4eda-b7f2-ff90545da102 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:48.064939 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-249eb9f8-ad45-4eda-b7f2-ff90545da102 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:48.066044 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-249eb9f8-ad45-4eda-b7f2-ff90545da102 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:48.066767 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-249eb9f8-ad45-4eda-b7f2-ff90545da102 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:48.067451 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-249eb9f8-ad45-4eda-b7f2-ff90545da102 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:48.203846 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-249eb9f8-ad45-4eda-b7f2-ff90545da102 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:48.215492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-249eb9f8-ad45-4eda-b7f2-ff90545da102 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.169318 Aug 28 10:17:48.216248 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 152/282] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:48 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:48.618349 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-9d5ed3f1-b6f1-4d09-a18e-35c908633040 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:48.618979 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-9d5ed3f1-b6f1-4d09-a18e-35c908633040 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:48.626239 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9d5ed3f1-b6f1-4d09-a18e-35c908633040 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:48.626721 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9d5ed3f1-b6f1-4d09-a18e-35c908633040 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:48.627149 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9d5ed3f1-b6f1-4d09-a18e-35c908633040 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:48.627842 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9d5ed3f1-b6f1-4d09-a18e-35c908633040 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:48.628265 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9d5ed3f1-b6f1-4d09-a18e-35c908633040 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:48.628745 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9d5ed3f1-b6f1-4d09-a18e-35c908633040 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:48.688430 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-9d5ed3f1-b6f1-4d09-a18e-35c908633040 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:48.696197 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-9d5ed3f1-b6f1-4d09-a18e-35c908633040 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1241 microversion: 2.1 time: 0.081803 Aug 28 10:17:48.696807 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 131/283] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:48 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:49.240311 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f399a116-2e42-44c8-b5d4-59f6bdf81877 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:49.241335 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f399a116-2e42-44c8-b5d4-59f6bdf81877 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:49.253595 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f399a116-2e42-44c8-b5d4-59f6bdf81877 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:49.254370 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f399a116-2e42-44c8-b5d4-59f6bdf81877 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:49.255040 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f399a116-2e42-44c8-b5d4-59f6bdf81877 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:49.256134 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f399a116-2e42-44c8-b5d4-59f6bdf81877 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:49.256900 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f399a116-2e42-44c8-b5d4-59f6bdf81877 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:49.257491 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f399a116-2e42-44c8-b5d4-59f6bdf81877 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:49.396042 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f399a116-2e42-44c8-b5d4-59f6bdf81877 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:49.404080 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f399a116-2e42-44c8-b5d4-59f6bdf81877 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.170115 Aug 28 10:17:49.404746 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 153/284] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:49 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:49.717773 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-61102e6b-bb41-4547-9baf-9c300b7c78e0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:49.718301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-61102e6b-bb41-4547-9baf-9c300b7c78e0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:49.725149 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61102e6b-bb41-4547-9baf-9c300b7c78e0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:49.725623 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61102e6b-bb41-4547-9baf-9c300b7c78e0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:49.726043 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61102e6b-bb41-4547-9baf-9c300b7c78e0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:49.726723 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61102e6b-bb41-4547-9baf-9c300b7c78e0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:49.727180 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61102e6b-bb41-4547-9baf-9c300b7c78e0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:49.727592 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61102e6b-bb41-4547-9baf-9c300b7c78e0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:49.791845 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-61102e6b-bb41-4547-9baf-9c300b7c78e0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:49.799553 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-61102e6b-bb41-4547-9baf-9c300b7c78e0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1241 microversion: 2.1 time: 0.086641 Aug 28 10:17:49.800102 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 132/285] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:49 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:50.425317 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-27546bf5-2b1a-4017-bff8-60fe87b0ed63 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:50.425924 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-27546bf5-2b1a-4017-bff8-60fe87b0ed63 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:50.432470 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-27546bf5-2b1a-4017-bff8-60fe87b0ed63 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:50.432987 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-27546bf5-2b1a-4017-bff8-60fe87b0ed63 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:50.433433 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-27546bf5-2b1a-4017-bff8-60fe87b0ed63 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:50.434109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-27546bf5-2b1a-4017-bff8-60fe87b0ed63 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:50.434550 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-27546bf5-2b1a-4017-bff8-60fe87b0ed63 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:50.434960 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-27546bf5-2b1a-4017-bff8-60fe87b0ed63 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:50.563523 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-27546bf5-2b1a-4017-bff8-60fe87b0ed63 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:50.571512 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-27546bf5-2b1a-4017-bff8-60fe87b0ed63 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.149988 Aug 28 10:17:50.572082 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 154/286] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:50 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:50.824382 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-796824e2-63a3-4cf5-ac4d-689ee0beac3b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:50.825382 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-796824e2-63a3-4cf5-ac4d-689ee0beac3b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:50.833406 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-796824e2-63a3-4cf5-ac4d-689ee0beac3b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:50.833885 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-796824e2-63a3-4cf5-ac4d-689ee0beac3b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:50.834311 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-796824e2-63a3-4cf5-ac4d-689ee0beac3b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:50.834987 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-796824e2-63a3-4cf5-ac4d-689ee0beac3b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:50.835433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-796824e2-63a3-4cf5-ac4d-689ee0beac3b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:50.835836 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-796824e2-63a3-4cf5-ac4d-689ee0beac3b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:51.039651 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-796824e2-63a3-4cf5-ac4d-689ee0beac3b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:51.047397 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-796824e2-63a3-4cf5-ac4d-689ee0beac3b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1241 microversion: 2.1 time: 0.229446 Aug 28 10:17:51.047960 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 133/287] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:50 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1241 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:51.595480 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-09c5b35a-4fd2-4051-ae1a-e1ef71465d79 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:51.596432 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-09c5b35a-4fd2-4051-ae1a-e1ef71465d79 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:51.607257 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-09c5b35a-4fd2-4051-ae1a-e1ef71465d79 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:51.608056 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-09c5b35a-4fd2-4051-ae1a-e1ef71465d79 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:51.608810 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-09c5b35a-4fd2-4051-ae1a-e1ef71465d79 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:51.609874 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-09c5b35a-4fd2-4051-ae1a-e1ef71465d79 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:51.610298 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-09c5b35a-4fd2-4051-ae1a-e1ef71465d79 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:51.610716 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-09c5b35a-4fd2-4051-ae1a-e1ef71465d79 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:51.747528 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-09c5b35a-4fd2-4051-ae1a-e1ef71465d79 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:51.755479 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-09c5b35a-4fd2-4051-ae1a-e1ef71465d79 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.166711 Aug 28 10:17:51.756045 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 155/288] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:51 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:52.067858 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-fe1014d2-1f11-41e3-abf1-92872130619f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:52.068429 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-fe1014d2-1f11-41e3-abf1-92872130619f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:52.075832 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fe1014d2-1f11-41e3-abf1-92872130619f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:52.076305 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fe1014d2-1f11-41e3-abf1-92872130619f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:52.076881 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fe1014d2-1f11-41e3-abf1-92872130619f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:52.077560 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fe1014d2-1f11-41e3-abf1-92872130619f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:52.078087 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fe1014d2-1f11-41e3-abf1-92872130619f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:52.078452 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fe1014d2-1f11-41e3-abf1-92872130619f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:52.142715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-fe1014d2-1f11-41e3-abf1-92872130619f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:52.151106 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-fe1014d2-1f11-41e3-abf1-92872130619f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1289 microversion: 2.1 time: 0.087153 Aug 28 10:17:52.151698 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 134/289] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:52 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1289 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:52.777676 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1501e225-bb43-4c08-bae0-12ca9607d700 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:52.778748 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1501e225-bb43-4c08-bae0-12ca9607d700 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:52.785973 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1501e225-bb43-4c08-bae0-12ca9607d700 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:52.786524 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1501e225-bb43-4c08-bae0-12ca9607d700 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:52.786944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1501e225-bb43-4c08-bae0-12ca9607d700 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:52.787689 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1501e225-bb43-4c08-bae0-12ca9607d700 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:52.788320 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1501e225-bb43-4c08-bae0-12ca9607d700 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:52.788766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1501e225-bb43-4c08-bae0-12ca9607d700 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:52.921731 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1501e225-bb43-4c08-bae0-12ca9607d700 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:52.929501 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1501e225-bb43-4c08-bae0-12ca9607d700 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.156903 Aug 28 10:17:52.930059 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 156/290] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:52 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:53.172684 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-398ea3ab-32b4-4a7f-915e-8df39b6337bf tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:53.173594 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-398ea3ab-32b4-4a7f-915e-8df39b6337bf tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:53.175981 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=6 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:53.181300 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-398ea3ab-32b4-4a7f-915e-8df39b6337bf tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:53.181776 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-398ea3ab-32b4-4a7f-915e-8df39b6337bf tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:53.182210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-398ea3ab-32b4-4a7f-915e-8df39b6337bf tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:53.182894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-398ea3ab-32b4-4a7f-915e-8df39b6337bf tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:53.183578 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-398ea3ab-32b4-4a7f-915e-8df39b6337bf tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:53.184001 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-398ea3ab-32b4-4a7f-915e-8df39b6337bf tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:53.251028 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-398ea3ab-32b4-4a7f-915e-8df39b6337bf tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:53.258580 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-398ea3ab-32b4-4a7f-915e-8df39b6337bf tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1295 microversion: 2.1 time: 0.089885 Aug 28 10:17:53.259203 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 135/291] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:53 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1295 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:53.950320 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6ffdda17-a13d-47ec-8dc4-e15450f688cb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:53.956907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6ffdda17-a13d-47ec-8dc4-e15450f688cb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:53.958913 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:53.959726 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=6 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:53.965524 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ffdda17-a13d-47ec-8dc4-e15450f688cb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:53.966226 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ffdda17-a13d-47ec-8dc4-e15450f688cb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:53.966709 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ffdda17-a13d-47ec-8dc4-e15450f688cb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:53.967571 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ffdda17-a13d-47ec-8dc4-e15450f688cb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:53.968023 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ffdda17-a13d-47ec-8dc4-e15450f688cb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:53.968471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ffdda17-a13d-47ec-8dc4-e15450f688cb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:54.105894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-d28fa563-580f-4e1f-951a-bdc1b5edd07b req-26b7125b-4737-4eb4-9462-63d5064cb53c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71cd65ac-3099-4ac7-bf03-ed5173f6204f", "tag": "3aeb435e-89dc-490b-b3f2-e6029500bb1d"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:17:54.117309 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-d28fa563-580f-4e1f-951a-bdc1b5edd07b req-26b7125b-4737-4eb4-9462-63d5064cb53c service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:54.117924 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-d28fa563-580f-4e1f-951a-bdc1b5edd07b req-26b7125b-4737-4eb4-9462-63d5064cb53c service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:54.118521 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-d28fa563-580f-4e1f-951a-bdc1b5edd07b req-26b7125b-4737-4eb4-9462-63d5064cb53c service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:54.134133 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-d28fa563-580f-4e1f-951a-bdc1b5edd07b req-26b7125b-4737-4eb4-9462-63d5064cb53c service nova] Creating event network-changed:3aeb435e-89dc-490b-b3f2-e6029500bb1d for instance 71cd65ac-3099-4ac7-bf03-ed5173f6204f on hv-cinder-85200 Aug 28 10:17:54.140974 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-d28fa563-580f-4e1f-951a-bdc1b5edd07b req-26b7125b-4737-4eb4-9462-63d5064cb53c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039746 Aug 28 10:17:54.141994 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 136/292] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:17:54.160084 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6ffdda17-a13d-47ec-8dc4-e15450f688cb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:54.169752 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6ffdda17-a13d-47ec-8dc4-e15450f688cb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.223370 Aug 28 10:17:54.177110 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 157/293] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:53 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:54.280655 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c91adc07-fdfa-4c96-bea1-45a7db6aad88 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:54.282170 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c91adc07-fdfa-4c96-bea1-45a7db6aad88 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:54.289597 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c91adc07-fdfa-4c96-bea1-45a7db6aad88 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:54.290309 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c91adc07-fdfa-4c96-bea1-45a7db6aad88 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:54.290949 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c91adc07-fdfa-4c96-bea1-45a7db6aad88 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:54.291854 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c91adc07-fdfa-4c96-bea1-45a7db6aad88 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:54.292388 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c91adc07-fdfa-4c96-bea1-45a7db6aad88 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:54.292918 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c91adc07-fdfa-4c96-bea1-45a7db6aad88 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:54.482791 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c91adc07-fdfa-4c96-bea1-45a7db6aad88 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:54.493325 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c91adc07-fdfa-4c96-bea1-45a7db6aad88 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1362 microversion: 2.1 time: 0.217481 Aug 28 10:17:54.494070 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 137/294] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:54 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:55.190770 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-90f1b919-6f9f-4a10-aac4-35d2ebe37d2e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:55.191381 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-90f1b919-6f9f-4a10-aac4-35d2ebe37d2e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:55.197716 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-90f1b919-6f9f-4a10-aac4-35d2ebe37d2e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:55.198201 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-90f1b919-6f9f-4a10-aac4-35d2ebe37d2e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:55.198605 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-90f1b919-6f9f-4a10-aac4-35d2ebe37d2e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:55.199307 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-90f1b919-6f9f-4a10-aac4-35d2ebe37d2e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:55.199740 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-90f1b919-6f9f-4a10-aac4-35d2ebe37d2e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:55.200143 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-90f1b919-6f9f-4a10-aac4-35d2ebe37d2e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:55.222337 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:55.339521 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-90f1b919-6f9f-4a10-aac4-35d2ebe37d2e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:55.347598 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-90f1b919-6f9f-4a10-aac4-35d2ebe37d2e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.160779 Aug 28 10:17:55.348178 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 158/295] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:55 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:55.514227 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-5c0af27a-7982-4381-b1dc-33dfad998338 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:55.514837 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-5c0af27a-7982-4381-b1dc-33dfad998338 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:55.521711 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5c0af27a-7982-4381-b1dc-33dfad998338 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:55.522209 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5c0af27a-7982-4381-b1dc-33dfad998338 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:55.522773 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5c0af27a-7982-4381-b1dc-33dfad998338 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:55.523435 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5c0af27a-7982-4381-b1dc-33dfad998338 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:55.523881 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5c0af27a-7982-4381-b1dc-33dfad998338 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:55.524291 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5c0af27a-7982-4381-b1dc-33dfad998338 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:55.545087 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=100 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:55.659084 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-5c0af27a-7982-4381-b1dc-33dfad998338 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:55.667610 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-5c0af27a-7982-4381-b1dc-33dfad998338 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1362 microversion: 2.1 time: 0.157281 Aug 28 10:17:55.668343 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 138/296] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:55 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:56.368450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b0fdcf8f-49b6-4601-8ed4-c5926ddbe28e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:56.369699 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b0fdcf8f-49b6-4601-8ed4-c5926ddbe28e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:56.375895 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b0fdcf8f-49b6-4601-8ed4-c5926ddbe28e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:56.376378 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b0fdcf8f-49b6-4601-8ed4-c5926ddbe28e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:56.376843 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b0fdcf8f-49b6-4601-8ed4-c5926ddbe28e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:56.377590 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b0fdcf8f-49b6-4601-8ed4-c5926ddbe28e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:56.377966 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b0fdcf8f-49b6-4601-8ed4-c5926ddbe28e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:56.378578 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b0fdcf8f-49b6-4601-8ed4-c5926ddbe28e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:56.514717 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b0fdcf8f-49b6-4601-8ed4-c5926ddbe28e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:56.522608 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b0fdcf8f-49b6-4601-8ed4-c5926ddbe28e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.158852 Aug 28 10:17:56.523193 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 159/297] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:56 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:56.688456 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-5516705a-1ed0-4e28-862a-bb24ec82a6cd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:56.689108 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-5516705a-1ed0-4e28-862a-bb24ec82a6cd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:56.695809 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5516705a-1ed0-4e28-862a-bb24ec82a6cd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:56.696357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5516705a-1ed0-4e28-862a-bb24ec82a6cd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:56.696863 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5516705a-1ed0-4e28-862a-bb24ec82a6cd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:56.697629 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5516705a-1ed0-4e28-862a-bb24ec82a6cd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:56.698167 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5516705a-1ed0-4e28-862a-bb24ec82a6cd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:56.698669 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5516705a-1ed0-4e28-862a-bb24ec82a6cd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:57.085888 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-5516705a-1ed0-4e28-862a-bb24ec82a6cd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:57.096177 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-5516705a-1ed0-4e28-862a-bb24ec82a6cd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1362 microversion: 2.1 time: 0.411679 Aug 28 10:17:57.096803 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 139/298] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:56 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1362 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:57.543836 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c3ca9f28-41b5-496b-b812-099da77db47a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:57.544467 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c3ca9f28-41b5-496b-b812-099da77db47a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:57.550815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3ca9f28-41b5-496b-b812-099da77db47a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:57.551296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3ca9f28-41b5-496b-b812-099da77db47a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:57.551722 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3ca9f28-41b5-496b-b812-099da77db47a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:57.552407 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3ca9f28-41b5-496b-b812-099da77db47a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:57.552882 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3ca9f28-41b5-496b-b812-099da77db47a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:57.553297 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3ca9f28-41b5-496b-b812-099da77db47a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:57.684210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c3ca9f28-41b5-496b-b812-099da77db47a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:57.692008 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c3ca9f28-41b5-496b-b812-099da77db47a tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.152093 Aug 28 10:17:57.692823 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 160/299] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:57 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:58.118297 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-450bbd1e-13b0-41be-b5e0-31717a2242eb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:58.119120 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-450bbd1e-13b0-41be-b5e0-31717a2242eb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:58.130290 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-450bbd1e-13b0-41be-b5e0-31717a2242eb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:58.131045 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-450bbd1e-13b0-41be-b5e0-31717a2242eb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:58.131680 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-450bbd1e-13b0-41be-b5e0-31717a2242eb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:58.132730 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-450bbd1e-13b0-41be-b5e0-31717a2242eb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:58.133399 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-450bbd1e-13b0-41be-b5e0-31717a2242eb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:58.133858 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-450bbd1e-13b0-41be-b5e0-31717a2242eb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:58.294658 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-450bbd1e-13b0-41be-b5e0-31717a2242eb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:58.303188 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-450bbd1e-13b0-41be-b5e0-31717a2242eb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1362 microversion: 2.1 time: 0.188815 Aug 28 10:17:58.304220 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 140/300] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:58 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:58.713751 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c1ed7a11-d4bc-4f3d-9c85-5da600a6b0c0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:58.714439 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c1ed7a11-d4bc-4f3d-9c85-5da600a6b0c0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:58.720575 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c1ed7a11-d4bc-4f3d-9c85-5da600a6b0c0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:58.721050 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c1ed7a11-d4bc-4f3d-9c85-5da600a6b0c0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:58.721465 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c1ed7a11-d4bc-4f3d-9c85-5da600a6b0c0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:58.722220 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c1ed7a11-d4bc-4f3d-9c85-5da600a6b0c0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:58.722661 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c1ed7a11-d4bc-4f3d-9c85-5da600a6b0c0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:58.723073 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c1ed7a11-d4bc-4f3d-9c85-5da600a6b0c0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:58.884169 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c1ed7a11-d4bc-4f3d-9c85-5da600a6b0c0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:58.899198 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c1ed7a11-d4bc-4f3d-9c85-5da600a6b0c0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.189657 Aug 28 10:17:58.899935 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 161/301] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:58 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:59.327073 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-a11eb019-d098-4337-8346-5be54107fa25 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:59.327633 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-a11eb019-d098-4337-8346-5be54107fa25 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:59.334455 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a11eb019-d098-4337-8346-5be54107fa25 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:59.335435 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a11eb019-d098-4337-8346-5be54107fa25 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:59.336359 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a11eb019-d098-4337-8346-5be54107fa25 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:59.337358 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a11eb019-d098-4337-8346-5be54107fa25 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:59.337978 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a11eb019-d098-4337-8346-5be54107fa25 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:59.338722 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a11eb019-d098-4337-8346-5be54107fa25 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:59.533100 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-a11eb019-d098-4337-8346-5be54107fa25 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:17:59.542690 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-a11eb019-d098-4337-8346-5be54107fa25 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1362 microversion: 2.1 time: 0.220471 Aug 28 10:17:59.543274 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 141/302] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:59 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:17:59.924635 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9afcc89d-ff50-4eb5-86a3-b638cdb6bea7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:17:59.926475 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9afcc89d-ff50-4eb5-86a3-b638cdb6bea7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:17:59.934412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9afcc89d-ff50-4eb5-86a3-b638cdb6bea7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:59.934895 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9afcc89d-ff50-4eb5-86a3-b638cdb6bea7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:59.935321 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9afcc89d-ff50-4eb5-86a3-b638cdb6bea7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:17:59.936019 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9afcc89d-ff50-4eb5-86a3-b638cdb6bea7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:17:59.936466 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9afcc89d-ff50-4eb5-86a3-b638cdb6bea7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:17:59.937642 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9afcc89d-ff50-4eb5-86a3-b638cdb6bea7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:00.067624 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9afcc89d-ff50-4eb5-86a3-b638cdb6bea7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:00.075521 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9afcc89d-ff50-4eb5-86a3-b638cdb6bea7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.159098 Aug 28 10:18:00.076106 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 162/303] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:17:59 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:00.563625 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-41967588-d90c-46fc-bf09-0a1f178e1b28 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:00.564228 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-41967588-d90c-46fc-bf09-0a1f178e1b28 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:00.570804 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-41967588-d90c-46fc-bf09-0a1f178e1b28 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:00.571278 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-41967588-d90c-46fc-bf09-0a1f178e1b28 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:00.571762 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-41967588-d90c-46fc-bf09-0a1f178e1b28 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:00.572373 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-41967588-d90c-46fc-bf09-0a1f178e1b28 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:00.572852 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-41967588-d90c-46fc-bf09-0a1f178e1b28 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:00.573271 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-41967588-d90c-46fc-bf09-0a1f178e1b28 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:00.750515 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-41967588-d90c-46fc-bf09-0a1f178e1b28 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:00.758278 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-41967588-d90c-46fc-bf09-0a1f178e1b28 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1362 microversion: 2.1 time: 0.198504 Aug 28 10:18:00.758852 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 142/304] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:00 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:01.095525 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5f684e4b-a3dc-4226-b5d4-671a0e5f0150 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:01.096146 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5f684e4b-a3dc-4226-b5d4-671a0e5f0150 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:01.102603 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5f684e4b-a3dc-4226-b5d4-671a0e5f0150 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:01.103128 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5f684e4b-a3dc-4226-b5d4-671a0e5f0150 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:01.103753 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5f684e4b-a3dc-4226-b5d4-671a0e5f0150 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:01.104547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5f684e4b-a3dc-4226-b5d4-671a0e5f0150 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:01.105116 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5f684e4b-a3dc-4226-b5d4-671a0e5f0150 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:01.105722 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5f684e4b-a3dc-4226-b5d4-671a0e5f0150 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:01.242718 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5f684e4b-a3dc-4226-b5d4-671a0e5f0150 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:01.250443 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5f684e4b-a3dc-4226-b5d4-671a0e5f0150 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.158940 Aug 28 10:18:01.251024 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 163/305] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:01 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:01.492012 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-5fcc79e0-5d6d-46d3-997e-1b1268822e45 req-98f2b3b3-35d9-4c73-b1b3-6a855d827144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71cd65ac-3099-4ac7-bf03-ed5173f6204f", "name": "network-vif-plugged", "status": "completed", "tag": "3aeb435e-89dc-490b-b3f2-e6029500bb1d"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:18:01.504455 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-5fcc79e0-5d6d-46d3-997e-1b1268822e45 req-98f2b3b3-35d9-4c73-b1b3-6a855d827144 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:01.504957 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-5fcc79e0-5d6d-46d3-997e-1b1268822e45 req-98f2b3b3-35d9-4c73-b1b3-6a855d827144 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:01.505354 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-5fcc79e0-5d6d-46d3-997e-1b1268822e45 req-98f2b3b3-35d9-4c73-b1b3-6a855d827144 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:01.517319 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-5fcc79e0-5d6d-46d3-997e-1b1268822e45 req-98f2b3b3-35d9-4c73-b1b3-6a855d827144 service nova] Creating event network-vif-plugged:3aeb435e-89dc-490b-b3f2-e6029500bb1d for instance 71cd65ac-3099-4ac7-bf03-ed5173f6204f on hv-cinder-85200 Aug 28 10:18:01.523403 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-5fcc79e0-5d6d-46d3-997e-1b1268822e45 req-98f2b3b3-35d9-4c73-b1b3-6a855d827144 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036121 Aug 28 10:18:01.524000 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 143/306] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:18:01.778846 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0e909ac8-d430-48f7-b38f-b85ab990ab2c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:01.779442 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0e909ac8-d430-48f7-b38f-b85ab990ab2c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:01.786352 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e909ac8-d430-48f7-b38f-b85ab990ab2c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:01.786902 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e909ac8-d430-48f7-b38f-b85ab990ab2c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:01.787487 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e909ac8-d430-48f7-b38f-b85ab990ab2c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:01.788214 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e909ac8-d430-48f7-b38f-b85ab990ab2c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:01.788641 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e909ac8-d430-48f7-b38f-b85ab990ab2c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:01.789395 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e909ac8-d430-48f7-b38f-b85ab990ab2c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:01.940226 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0e909ac8-d430-48f7-b38f-b85ab990ab2c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:01.949939 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0e909ac8-d430-48f7-b38f-b85ab990ab2c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1362 microversion: 2.1 time: 0.174844 Aug 28 10:18:01.951481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 164/307] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:01 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:02.273573 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-38b96b04-f767-4883-a20f-af6b5524ab9e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:02.274198 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-38b96b04-f767-4883-a20f-af6b5524ab9e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:02.281945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-38b96b04-f767-4883-a20f-af6b5524ab9e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:02.282574 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-38b96b04-f767-4883-a20f-af6b5524ab9e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:02.283074 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-38b96b04-f767-4883-a20f-af6b5524ab9e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:02.283910 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-38b96b04-f767-4883-a20f-af6b5524ab9e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:02.284462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-38b96b04-f767-4883-a20f-af6b5524ab9e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:02.284978 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-38b96b04-f767-4883-a20f-af6b5524ab9e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:02.421116 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-38b96b04-f767-4883-a20f-af6b5524ab9e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:02.431687 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-38b96b04-f767-4883-a20f-af6b5524ab9e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.163882 Aug 28 10:18:02.432264 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 144/308] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:02 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:02.975521 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7ed61bc6-cc31-4abb-96b1-47159362094d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:02.976644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7ed61bc6-cc31-4abb-96b1-47159362094d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:02.986533 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ed61bc6-cc31-4abb-96b1-47159362094d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:02.987011 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ed61bc6-cc31-4abb-96b1-47159362094d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:02.987434 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ed61bc6-cc31-4abb-96b1-47159362094d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:02.988120 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ed61bc6-cc31-4abb-96b1-47159362094d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:02.988592 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ed61bc6-cc31-4abb-96b1-47159362094d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:02.989008 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ed61bc6-cc31-4abb-96b1-47159362094d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:03.133565 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7ed61bc6-cc31-4abb-96b1-47159362094d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:03.142329 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7ed61bc6-cc31-4abb-96b1-47159362094d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1362 microversion: 2.1 time: 0.173445 Aug 28 10:18:03.143825 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 165/309] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:02 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:03.455663 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-1168d3b0-0028-48c2-ae6a-ce33e496f43c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:03.456259 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-1168d3b0-0028-48c2-ae6a-ce33e496f43c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:03.463292 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1168d3b0-0028-48c2-ae6a-ce33e496f43c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:03.463775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1168d3b0-0028-48c2-ae6a-ce33e496f43c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:03.464204 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1168d3b0-0028-48c2-ae6a-ce33e496f43c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:03.464928 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1168d3b0-0028-48c2-ae6a-ce33e496f43c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:03.465378 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1168d3b0-0028-48c2-ae6a-ce33e496f43c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:03.465798 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1168d3b0-0028-48c2-ae6a-ce33e496f43c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:03.603399 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-1168d3b0-0028-48c2-ae6a-ce33e496f43c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:03.611709 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-1168d3b0-0028-48c2-ae6a-ce33e496f43c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.162064 Aug 28 10:18:03.612284 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 145/310] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:03 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:04.163752 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-81d91142-983d-4914-835f-03fc134af698 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:04.164768 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-81d91142-983d-4914-835f-03fc134af698 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:04.171208 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81d91142-983d-4914-835f-03fc134af698 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:04.171688 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81d91142-983d-4914-835f-03fc134af698 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:04.172090 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81d91142-983d-4914-835f-03fc134af698 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:04.172966 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81d91142-983d-4914-835f-03fc134af698 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:04.173422 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81d91142-983d-4914-835f-03fc134af698 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:04.173844 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81d91142-983d-4914-835f-03fc134af698 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:04.302520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-81d91142-983d-4914-835f-03fc134af698 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:04.310385 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-81d91142-983d-4914-835f-03fc134af698 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1362 microversion: 2.1 time: 0.150537 Aug 28 10:18:04.310952 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 166/311] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:04 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:04.634215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-0714d5b7-ba83-4b01-806a-9d58360aaab0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:04.634994 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-0714d5b7-ba83-4b01-806a-9d58360aaab0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:04.643817 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0714d5b7-ba83-4b01-806a-9d58360aaab0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:04.644444 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0714d5b7-ba83-4b01-806a-9d58360aaab0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:04.645067 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0714d5b7-ba83-4b01-806a-9d58360aaab0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:04.645973 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0714d5b7-ba83-4b01-806a-9d58360aaab0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:04.646559 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0714d5b7-ba83-4b01-806a-9d58360aaab0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:04.647109 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0714d5b7-ba83-4b01-806a-9d58360aaab0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:04.785370 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-0714d5b7-ba83-4b01-806a-9d58360aaab0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:04.797404 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-0714d5b7-ba83-4b01-806a-9d58360aaab0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.168216 Aug 28 10:18:04.798524 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 146/312] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:04 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:05.331425 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a302003c-0059-4924-a110-310f4f1d9860 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:05.332201 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a302003c-0059-4924-a110-310f4f1d9860 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:05.338607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a302003c-0059-4924-a110-310f4f1d9860 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:05.339066 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a302003c-0059-4924-a110-310f4f1d9860 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:05.339492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a302003c-0059-4924-a110-310f4f1d9860 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:05.340167 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a302003c-0059-4924-a110-310f4f1d9860 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:05.340639 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a302003c-0059-4924-a110-310f4f1d9860 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:05.341059 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a302003c-0059-4924-a110-310f4f1d9860 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:05.480868 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a302003c-0059-4924-a110-310f4f1d9860 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:05.492599 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a302003c-0059-4924-a110-310f4f1d9860 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1362 microversion: 2.1 time: 0.164952 Aug 28 10:18:05.493379 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 167/313] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:05 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:05.822909 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-7f5c7307-ba18-4266-97a7-eca5e7f18594 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:05.823444 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-7f5c7307-ba18-4266-97a7-eca5e7f18594 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:05.830520 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7f5c7307-ba18-4266-97a7-eca5e7f18594 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:05.830996 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7f5c7307-ba18-4266-97a7-eca5e7f18594 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:05.831429 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7f5c7307-ba18-4266-97a7-eca5e7f18594 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:05.832116 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7f5c7307-ba18-4266-97a7-eca5e7f18594 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:05.832563 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7f5c7307-ba18-4266-97a7-eca5e7f18594 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:05.833010 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7f5c7307-ba18-4266-97a7-eca5e7f18594 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:05.966900 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7f5c7307-ba18-4266-97a7-eca5e7f18594 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:05.978630 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-7f5c7307-ba18-4266-97a7-eca5e7f18594 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.159542 Aug 28 10:18:05.979430 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 147/314] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:05 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:06.518593 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0bcec280-93f8-4e36-ad86-351d7e890e64 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:06.519255 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0bcec280-93f8-4e36-ad86-351d7e890e64 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:06.527058 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0bcec280-93f8-4e36-ad86-351d7e890e64 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:06.527648 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0bcec280-93f8-4e36-ad86-351d7e890e64 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:06.528174 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0bcec280-93f8-4e36-ad86-351d7e890e64 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:06.529145 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0bcec280-93f8-4e36-ad86-351d7e890e64 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:06.529697 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0bcec280-93f8-4e36-ad86-351d7e890e64 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:06.530244 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0bcec280-93f8-4e36-ad86-351d7e890e64 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:06.662383 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0bcec280-93f8-4e36-ad86-351d7e890e64 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:06.670982 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0bcec280-93f8-4e36-ad86-351d7e890e64 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1362 microversion: 2.1 time: 0.158525 Aug 28 10:18:06.671562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 168/315] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:06 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:07.003739 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-46f57e60-e38e-4811-ab0d-d8aa6fdde355 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:07.004300 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-46f57e60-e38e-4811-ab0d-d8aa6fdde355 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:07.012356 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46f57e60-e38e-4811-ab0d-d8aa6fdde355 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:07.012864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46f57e60-e38e-4811-ab0d-d8aa6fdde355 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:07.013264 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46f57e60-e38e-4811-ab0d-d8aa6fdde355 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:07.013961 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46f57e60-e38e-4811-ab0d-d8aa6fdde355 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:07.014434 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46f57e60-e38e-4811-ab0d-d8aa6fdde355 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:07.014844 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46f57e60-e38e-4811-ab0d-d8aa6fdde355 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:07.148283 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-46f57e60-e38e-4811-ab0d-d8aa6fdde355 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:07.156403 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-46f57e60-e38e-4811-ab0d-d8aa6fdde355 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.158758 Aug 28 10:18:07.157013 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 148/316] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:06 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:07.696159 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4879fd5c-433c-458e-b9cd-63292df23713 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:07.697167 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4879fd5c-433c-458e-b9cd-63292df23713 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:07.707595 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4879fd5c-433c-458e-b9cd-63292df23713 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:07.708394 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4879fd5c-433c-458e-b9cd-63292df23713 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:07.709169 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4879fd5c-433c-458e-b9cd-63292df23713 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:07.710295 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4879fd5c-433c-458e-b9cd-63292df23713 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:07.711044 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4879fd5c-433c-458e-b9cd-63292df23713 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:07.711742 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4879fd5c-433c-458e-b9cd-63292df23713 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:07.858797 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4879fd5c-433c-458e-b9cd-63292df23713 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:07.871220 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4879fd5c-433c-458e-b9cd-63292df23713 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1362 microversion: 2.1 time: 0.181312 Aug 28 10:18:07.872037 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 169/317] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:07 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:08.180206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-cb2713a4-4cd5-4c88-9bf7-1ab92315caa6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:08.181071 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-cb2713a4-4cd5-4c88-9bf7-1ab92315caa6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:08.191563 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cb2713a4-4cd5-4c88-9bf7-1ab92315caa6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:08.192287 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cb2713a4-4cd5-4c88-9bf7-1ab92315caa6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:08.193153 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cb2713a4-4cd5-4c88-9bf7-1ab92315caa6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:08.194179 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cb2713a4-4cd5-4c88-9bf7-1ab92315caa6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:08.194871 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cb2713a4-4cd5-4c88-9bf7-1ab92315caa6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:08.195534 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cb2713a4-4cd5-4c88-9bf7-1ab92315caa6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:08.328756 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-cb2713a4-4cd5-4c88-9bf7-1ab92315caa6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:08.338670 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-cb2713a4-4cd5-4c88-9bf7-1ab92315caa6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.163764 Aug 28 10:18:08.346986 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 149/318] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:08 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:08.895552 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a3ca47e1-b024-4e0c-ba2d-37aa19486bcb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:08.896579 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a3ca47e1-b024-4e0c-ba2d-37aa19486bcb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:08.906549 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a3ca47e1-b024-4e0c-ba2d-37aa19486bcb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:08.907326 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a3ca47e1-b024-4e0c-ba2d-37aa19486bcb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:08.908019 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a3ca47e1-b024-4e0c-ba2d-37aa19486bcb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:08.909168 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a3ca47e1-b024-4e0c-ba2d-37aa19486bcb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:08.909901 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a3ca47e1-b024-4e0c-ba2d-37aa19486bcb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:08.910579 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a3ca47e1-b024-4e0c-ba2d-37aa19486bcb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:09.052164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a3ca47e1-b024-4e0c-ba2d-37aa19486bcb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:09.060153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a3ca47e1-b024-4e0c-ba2d-37aa19486bcb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1362 microversion: 2.1 time: 0.171203 Aug 28 10:18:09.060731 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 170/319] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:08 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:09.362555 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8b6e7152-feb4-48eb-9cdd-cd4322cc9349 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:09.363550 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-8b6e7152-feb4-48eb-9cdd-cd4322cc9349 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:09.374609 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8b6e7152-feb4-48eb-9cdd-cd4322cc9349 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:09.375403 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8b6e7152-feb4-48eb-9cdd-cd4322cc9349 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:09.376156 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8b6e7152-feb4-48eb-9cdd-cd4322cc9349 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:09.377312 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8b6e7152-feb4-48eb-9cdd-cd4322cc9349 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:09.378115 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8b6e7152-feb4-48eb-9cdd-cd4322cc9349 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:09.378529 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8b6e7152-feb4-48eb-9cdd-cd4322cc9349 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:09.515725 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8b6e7152-feb4-48eb-9cdd-cd4322cc9349 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:09.523572 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-8b6e7152-feb4-48eb-9cdd-cd4322cc9349 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.167681 Aug 28 10:18:09.524143 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 150/320] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:09 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:10.085024 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-963965eb-7726-4141-9f40-92f047c3b479 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:10.086015 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-963965eb-7726-4141-9f40-92f047c3b479 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:10.096616 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-963965eb-7726-4141-9f40-92f047c3b479 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:10.097144 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-963965eb-7726-4141-9f40-92f047c3b479 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:10.097576 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-963965eb-7726-4141-9f40-92f047c3b479 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:10.098262 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-963965eb-7726-4141-9f40-92f047c3b479 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:10.098703 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-963965eb-7726-4141-9f40-92f047c3b479 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:10.099118 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-963965eb-7726-4141-9f40-92f047c3b479 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:10.237664 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-963965eb-7726-4141-9f40-92f047c3b479 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:10.245755 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-963965eb-7726-4141-9f40-92f047c3b479 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1362 microversion: 2.1 time: 0.167398 Aug 28 10:18:10.246297 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 171/321] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:10 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:10.545018 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e9c9c040-f6ee-459d-9c5c-58d1235c8506 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:10.545845 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e9c9c040-f6ee-459d-9c5c-58d1235c8506 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:10.549860 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:10.554372 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e9c9c040-f6ee-459d-9c5c-58d1235c8506 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:10.555508 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e9c9c040-f6ee-459d-9c5c-58d1235c8506 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:10.556431 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e9c9c040-f6ee-459d-9c5c-58d1235c8506 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:10.557352 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e9c9c040-f6ee-459d-9c5c-58d1235c8506 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:10.558004 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e9c9c040-f6ee-459d-9c5c-58d1235c8506 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:10.558600 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e9c9c040-f6ee-459d-9c5c-58d1235c8506 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:10.705629 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-e9c9c040-f6ee-459d-9c5c-58d1235c8506 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:10.713494 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-e9c9c040-f6ee-459d-9c5c-58d1235c8506 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.172689 Aug 28 10:18:10.714065 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 151/322] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:10 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:11.277993 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-305dbcc5-e4ca-464b-b3ca-2f1e7f4d4bf3 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:11.279049 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-305dbcc5-e4ca-464b-b3ca-2f1e7f4d4bf3 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:11.287456 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-305dbcc5-e4ca-464b-b3ca-2f1e7f4d4bf3 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:11.287938 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-305dbcc5-e4ca-464b-b3ca-2f1e7f4d4bf3 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:11.288369 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-305dbcc5-e4ca-464b-b3ca-2f1e7f4d4bf3 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:11.289449 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-305dbcc5-e4ca-464b-b3ca-2f1e7f4d4bf3 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:11.289905 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-305dbcc5-e4ca-464b-b3ca-2f1e7f4d4bf3 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:11.290325 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-305dbcc5-e4ca-464b-b3ca-2f1e7f4d4bf3 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:11.426768 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-305dbcc5-e4ca-464b-b3ca-2f1e7f4d4bf3 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:11.434809 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-305dbcc5-e4ca-464b-b3ca-2f1e7f4d4bf3 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1362 microversion: 2.1 time: 0.163414 Aug 28 10:18:11.435390 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 172/323] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:11 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:11.737635 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e051d5ed-3916-4079-8848-3c8ce572f8fe tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:11.738403 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e051d5ed-3916-4079-8848-3c8ce572f8fe tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:11.746375 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e051d5ed-3916-4079-8848-3c8ce572f8fe tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:11.746934 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e051d5ed-3916-4079-8848-3c8ce572f8fe tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:11.747439 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e051d5ed-3916-4079-8848-3c8ce572f8fe tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:11.748240 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e051d5ed-3916-4079-8848-3c8ce572f8fe tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:11.748817 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e051d5ed-3916-4079-8848-3c8ce572f8fe tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:11.749314 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e051d5ed-3916-4079-8848-3c8ce572f8fe tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:11.893072 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-e051d5ed-3916-4079-8848-3c8ce572f8fe tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:11.904831 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-e051d5ed-3916-4079-8848-3c8ce572f8fe tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.173439 Aug 28 10:18:11.905623 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 152/324] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:11 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:12.459046 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0f7dd290-e529-46da-a996-f20d33719930 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:12.459759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0f7dd290-e529-46da-a996-f20d33719930 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:12.467572 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0f7dd290-e529-46da-a996-f20d33719930 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:12.468168 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0f7dd290-e529-46da-a996-f20d33719930 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:12.468747 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0f7dd290-e529-46da-a996-f20d33719930 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:12.469609 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0f7dd290-e529-46da-a996-f20d33719930 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:12.470167 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0f7dd290-e529-46da-a996-f20d33719930 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:12.470691 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0f7dd290-e529-46da-a996-f20d33719930 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:12.611344 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0f7dd290-e529-46da-a996-f20d33719930 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:12.619154 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0f7dd290-e529-46da-a996-f20d33719930 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1362 microversion: 2.1 time: 0.165910 Aug 28 10:18:12.621217 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 173/325] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:12 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:12.937492 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-3207451d-fbf5-44f0-9096-feb4da34ed9f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:12.938758 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-3207451d-fbf5-44f0-9096-feb4da34ed9f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:12.949588 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3207451d-fbf5-44f0-9096-feb4da34ed9f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:12.950306 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3207451d-fbf5-44f0-9096-feb4da34ed9f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:12.950933 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3207451d-fbf5-44f0-9096-feb4da34ed9f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:12.951896 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3207451d-fbf5-44f0-9096-feb4da34ed9f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:12.952573 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3207451d-fbf5-44f0-9096-feb4da34ed9f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:12.953136 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3207451d-fbf5-44f0-9096-feb4da34ed9f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:13.102259 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-3207451d-fbf5-44f0-9096-feb4da34ed9f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:13.111377 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-3207451d-fbf5-44f0-9096-feb4da34ed9f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.180501 Aug 28 10:18:13.111957 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 153/326] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:12 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:13.640176 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ba685e0c-aa0b-42ac-b3a2-7f295fffb907 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:13.641061 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ba685e0c-aa0b-42ac-b3a2-7f295fffb907 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:13.647551 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ba685e0c-aa0b-42ac-b3a2-7f295fffb907 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:13.648111 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ba685e0c-aa0b-42ac-b3a2-7f295fffb907 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:13.648757 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ba685e0c-aa0b-42ac-b3a2-7f295fffb907 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:13.649517 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ba685e0c-aa0b-42ac-b3a2-7f295fffb907 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:13.650034 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ba685e0c-aa0b-42ac-b3a2-7f295fffb907 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:13.650519 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ba685e0c-aa0b-42ac-b3a2-7f295fffb907 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:13.789984 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ba685e0c-aa0b-42ac-b3a2-7f295fffb907 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:13.793488 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:13.798234 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ba685e0c-aa0b-42ac-b3a2-7f295fffb907 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1362 microversion: 2.1 time: 0.162663 Aug 28 10:18:13.798751 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 174/327] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:13 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:14.132826 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-fd7316bc-5970-46d5-82b1-2f3ca81ce0f2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:14.133573 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-fd7316bc-5970-46d5-82b1-2f3ca81ce0f2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:14.140384 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fd7316bc-5970-46d5-82b1-2f3ca81ce0f2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:14.140976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fd7316bc-5970-46d5-82b1-2f3ca81ce0f2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:14.141480 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fd7316bc-5970-46d5-82b1-2f3ca81ce0f2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:14.142265 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fd7316bc-5970-46d5-82b1-2f3ca81ce0f2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:14.142713 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fd7316bc-5970-46d5-82b1-2f3ca81ce0f2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:14.143160 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fd7316bc-5970-46d5-82b1-2f3ca81ce0f2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:14.284843 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-fd7316bc-5970-46d5-82b1-2f3ca81ce0f2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:14.293121 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-fd7316bc-5970-46d5-82b1-2f3ca81ce0f2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1523 microversion: 2.1 time: 0.164860 Aug 28 10:18:14.293696 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 154/328] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:14 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:14.818840 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-95a4dd87-3107-49ed-9532-40a086d41869 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:14.819907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-95a4dd87-3107-49ed-9532-40a086d41869 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:14.826940 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95a4dd87-3107-49ed-9532-40a086d41869 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:14.827595 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95a4dd87-3107-49ed-9532-40a086d41869 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:14.828191 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95a4dd87-3107-49ed-9532-40a086d41869 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:14.829060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95a4dd87-3107-49ed-9532-40a086d41869 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:14.830034 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95a4dd87-3107-49ed-9532-40a086d41869 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:14.831103 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95a4dd87-3107-49ed-9532-40a086d41869 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:14.983104 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-95a4dd87-3107-49ed-9532-40a086d41869 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:14.991127 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-95a4dd87-3107-49ed-9532-40a086d41869 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1362 microversion: 2.1 time: 0.176258 Aug 28 10:18:14.991800 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 175/329] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:14 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:15.314126 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-24d4358c-6858-4cec-b3b9-1ce3cbdc6930 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:15.314726 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-24d4358c-6858-4cec-b3b9-1ce3cbdc6930 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:15.321709 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24d4358c-6858-4cec-b3b9-1ce3cbdc6930 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:15.322191 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24d4358c-6858-4cec-b3b9-1ce3cbdc6930 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:15.322616 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24d4358c-6858-4cec-b3b9-1ce3cbdc6930 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:15.323295 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24d4358c-6858-4cec-b3b9-1ce3cbdc6930 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:15.323742 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24d4358c-6858-4cec-b3b9-1ce3cbdc6930 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:15.324161 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24d4358c-6858-4cec-b3b9-1ce3cbdc6930 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:15.463307 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-24d4358c-6858-4cec-b3b9-1ce3cbdc6930 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:15.466753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=100 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:15.472433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-24d4358c-6858-4cec-b3b9-1ce3cbdc6930 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1503 microversion: 2.1 time: 0.162229 Aug 28 10:18:15.473063 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 155/330] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:15 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:15.492827 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a7f36ea1-1cf7-483d-98f5-53a74a41e7b0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:15.493434 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a7f36ea1-1cf7-483d-98f5-53a74a41e7b0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:15.500764 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a7f36ea1-1cf7-483d-98f5-53a74a41e7b0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:15.501250 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a7f36ea1-1cf7-483d-98f5-53a74a41e7b0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:15.501677 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a7f36ea1-1cf7-483d-98f5-53a74a41e7b0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:15.502361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a7f36ea1-1cf7-483d-98f5-53a74a41e7b0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:15.502805 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a7f36ea1-1cf7-483d-98f5-53a74a41e7b0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:15.503736 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a7f36ea1-1cf7-483d-98f5-53a74a41e7b0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:15.651522 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a7f36ea1-1cf7-483d-98f5-53a74a41e7b0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:15.659216 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a7f36ea1-1cf7-483d-98f5-53a74a41e7b0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed" status: 200 len: 1514 microversion: 2.1 time: 0.170989 Aug 28 10:18:15.659801 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 176/331] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:15 2022] GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:18:16.019993 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e9f5270b-5915-49c7-b0a1-f30e2d6fb077 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:16.020808 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e9f5270b-5915-49c7-b0a1-f30e2d6fb077 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:16.029095 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e9f5270b-5915-49c7-b0a1-f30e2d6fb077 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:16.031715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e9f5270b-5915-49c7-b0a1-f30e2d6fb077 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:16.033107 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e9f5270b-5915-49c7-b0a1-f30e2d6fb077 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:16.034064 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e9f5270b-5915-49c7-b0a1-f30e2d6fb077 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:16.034518 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e9f5270b-5915-49c7-b0a1-f30e2d6fb077 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:16.035099 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e9f5270b-5915-49c7-b0a1-f30e2d6fb077 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:16.183201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-e9f5270b-5915-49c7-b0a1-f30e2d6fb077 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:16.198458 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-e9f5270b-5915-49c7-b0a1-f30e2d6fb077 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1548 microversion: 2.1 time: 0.183771 Aug 28 10:18:16.208558 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 156/332] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:16 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1548 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:16.219278 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0f040c5c-d93d-4900-82b1-da826ac0c15d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:16.219843 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0f040c5c-d93d-4900-82b1-da826ac0c15d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:16.222811 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=54 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:16.229900 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0f040c5c-d93d-4900-82b1-da826ac0c15d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:16.230371 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0f040c5c-d93d-4900-82b1-da826ac0c15d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:16.230811 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0f040c5c-d93d-4900-82b1-da826ac0c15d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:16.231515 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0f040c5c-d93d-4900-82b1-da826ac0c15d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:16.231956 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0f040c5c-d93d-4900-82b1-da826ac0c15d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:16.232749 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0f040c5c-d93d-4900-82b1-da826ac0c15d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:16.312614 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0f040c5c-d93d-4900-82b1-da826ac0c15d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097471 Aug 28 10:18:16.313694 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 177/333] 10.222.0.40 () {58 vars in 1275 bytes} [Sun Aug 28 10:18:16 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:18:17.172945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-9b5e3acf-d004-4994-9f1e-d260a30af0f3 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:18:17.177914 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-9b5e3acf-d004-4994-9f1e-d260a30af0f3 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:17.196105 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9b5e3acf-d004-4994-9f1e-d260a30af0f3 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:17.196625 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9b5e3acf-d004-4994-9f1e-d260a30af0f3 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:17.197142 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9b5e3acf-d004-4994-9f1e-d260a30af0f3 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:17.197896 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9b5e3acf-d004-4994-9f1e-d260a30af0f3 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:17.198382 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9b5e3acf-d004-4994-9f1e-d260a30af0f3 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:17.198850 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9b5e3acf-d004-4994-9f1e-d260a30af0f3 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:17.232143 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.objects.instance [None req-9b5e3acf-d004-4994-9f1e-d260a30af0f3 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lazy-loading 'flavor' on Instance uuid c703c468-fcfc-41a1-ae56-4b9a516378ed {{(pid=120664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:18:17.374778 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-9b5e3acf-d004-4994-9f1e-d260a30af0f3 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "POST /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed/action" status: 200 len: 32 microversion: 2.1 time: 0.206474 Aug 28 10:18:17.380027 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 157/334] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Aug 28 10:18:17 2022] POST /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed/action => generated 32 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 28 10:18:17.386264 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-224ca41b-3851-487e-a26c-cd4548e3c859 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:17.387300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-224ca41b-3851-487e-a26c-cd4548e3c859 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:17.408351 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-224ca41b-3851-487e-a26c-cd4548e3c859 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:17.409810 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-224ca41b-3851-487e-a26c-cd4548e3c859 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:17.410297 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-224ca41b-3851-487e-a26c-cd4548e3c859 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:17.412558 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-224ca41b-3851-487e-a26c-cd4548e3c859 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:17.414028 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-224ca41b-3851-487e-a26c-cd4548e3c859 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:17.414888 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-224ca41b-3851-487e-a26c-cd4548e3c859 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:17.620535 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-6afed1c4-59c2-46a3-852c-e193a56f000b req-5f805d3a-e307-4107-b417-fe9dae12b912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71cd65ac-3099-4ac7-bf03-ed5173f6204f", "tag": "3aeb435e-89dc-490b-b3f2-e6029500bb1d"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:18:17.639442 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-6afed1c4-59c2-46a3-852c-e193a56f000b req-5f805d3a-e307-4107-b417-fe9dae12b912 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:17.639931 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-6afed1c4-59c2-46a3-852c-e193a56f000b req-5f805d3a-e307-4107-b417-fe9dae12b912 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:17.640360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-6afed1c4-59c2-46a3-852c-e193a56f000b req-5f805d3a-e307-4107-b417-fe9dae12b912 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:17.660317 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-6afed1c4-59c2-46a3-852c-e193a56f000b req-5f805d3a-e307-4107-b417-fe9dae12b912 service nova] Creating event network-changed:3aeb435e-89dc-490b-b3f2-e6029500bb1d for instance 71cd65ac-3099-4ac7-bf03-ed5173f6204f on hv-cinder-85200 Aug 28 10:18:17.667177 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-6afed1c4-59c2-46a3-852c-e193a56f000b req-5f805d3a-e307-4107-b417-fe9dae12b912 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051077 Aug 28 10:18:17.668362 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 158/335] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:18:17.680422 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-224ca41b-3851-487e-a26c-cd4548e3c859 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:17.692454 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-224ca41b-3851-487e-a26c-cd4548e3c859 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed" status: 200 len: 1520 microversion: 2.1 time: 0.310806 Aug 28 10:18:17.693545 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 178/336] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:17 2022] GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed => generated 1520 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:18.718151 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-24074d1a-0030-4dbf-a85a-4caeaa25115f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:18.719159 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-24074d1a-0030-4dbf-a85a-4caeaa25115f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:18.728854 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24074d1a-0030-4dbf-a85a-4caeaa25115f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:18.730370 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24074d1a-0030-4dbf-a85a-4caeaa25115f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:18.730809 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24074d1a-0030-4dbf-a85a-4caeaa25115f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:18.731518 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24074d1a-0030-4dbf-a85a-4caeaa25115f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:18.731969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24074d1a-0030-4dbf-a85a-4caeaa25115f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:18.736296 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24074d1a-0030-4dbf-a85a-4caeaa25115f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:18.924133 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-24074d1a-0030-4dbf-a85a-4caeaa25115f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:18.942987 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-24074d1a-0030-4dbf-a85a-4caeaa25115f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed" status: 200 len: 1520 microversion: 2.1 time: 0.231994 Aug 28 10:18:18.945448 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 159/337] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:18 2022] GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:19.967346 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-03481357-5e00-4bf4-a7b0-6db833fd0532 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:19.969478 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-03481357-5e00-4bf4-a7b0-6db833fd0532 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:19.976679 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-03481357-5e00-4bf4-a7b0-6db833fd0532 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:19.977401 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-03481357-5e00-4bf4-a7b0-6db833fd0532 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:19.978271 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-03481357-5e00-4bf4-a7b0-6db833fd0532 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:19.979358 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-03481357-5e00-4bf4-a7b0-6db833fd0532 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:19.979873 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-03481357-5e00-4bf4-a7b0-6db833fd0532 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:19.980524 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-03481357-5e00-4bf4-a7b0-6db833fd0532 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:20.162301 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-03481357-5e00-4bf4-a7b0-6db833fd0532 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:20.173794 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-03481357-5e00-4bf4-a7b0-6db833fd0532 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed" status: 200 len: 1520 microversion: 2.1 time: 0.210391 Aug 28 10:18:20.174406 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 179/338] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:19 2022] GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:21.194963 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-6a19fb0a-e42b-4231-9c54-b69de82eff25 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:21.195569 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-6a19fb0a-e42b-4231-9c54-b69de82eff25 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:21.207579 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6a19fb0a-e42b-4231-9c54-b69de82eff25 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:21.208061 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6a19fb0a-e42b-4231-9c54-b69de82eff25 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:21.208490 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6a19fb0a-e42b-4231-9c54-b69de82eff25 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:21.209267 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6a19fb0a-e42b-4231-9c54-b69de82eff25 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:21.209712 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6a19fb0a-e42b-4231-9c54-b69de82eff25 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:21.210126 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6a19fb0a-e42b-4231-9c54-b69de82eff25 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:21.392270 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-6a19fb0a-e42b-4231-9c54-b69de82eff25 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:21.408489 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-6a19fb0a-e42b-4231-9c54-b69de82eff25 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed" status: 200 len: 1520 microversion: 2.1 time: 0.216290 Aug 28 10:18:21.413392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 160/339] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:21 2022] GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:18:22.434321 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-63421745-b169-4c59-9269-167aa22dfaa0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:22.436219 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-63421745-b169-4c59-9269-167aa22dfaa0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:22.443175 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-63421745-b169-4c59-9269-167aa22dfaa0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:22.443725 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-63421745-b169-4c59-9269-167aa22dfaa0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:22.444220 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-63421745-b169-4c59-9269-167aa22dfaa0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:22.445419 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-63421745-b169-4c59-9269-167aa22dfaa0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:22.445989 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-63421745-b169-4c59-9269-167aa22dfaa0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:22.446549 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-63421745-b169-4c59-9269-167aa22dfaa0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:22.584152 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-63421745-b169-4c59-9269-167aa22dfaa0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:22.593009 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-63421745-b169-4c59-9269-167aa22dfaa0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed" status: 200 len: 1520 microversion: 2.1 time: 0.163540 Aug 28 10:18:22.593615 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 180/340] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:22 2022] GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:23.551388 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-759f0cea-dfa5-4f0f-9fdf-0257a4769cb9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-828478088", "imageRef": "2780c39b-8bd3-4e73-9669-2b2e29474f3e", "flavorRef": "452", "networks": [{"uuid": "ce8925b3-ae0f-47f4-a139-86fe56866f56"}]}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:18:23.610506 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.network.neutron [None req-759f0cea-dfa5-4f0f-9fdf-0257a4769cb9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] validate_networks() for [('ce8925b3-ae0f-47f4-a139-86fe56866f56', None, None, None, None, None)] {{(pid=120664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 28 10:18:23.614669 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1d8f1aa6-8bb5-452a-b932-b8254fba3d49 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:23.615564 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1d8f1aa6-8bb5-452a-b932-b8254fba3d49 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:23.621945 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d8f1aa6-8bb5-452a-b932-b8254fba3d49 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:23.622438 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d8f1aa6-8bb5-452a-b932-b8254fba3d49 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:23.622877 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d8f1aa6-8bb5-452a-b932-b8254fba3d49 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:23.623565 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d8f1aa6-8bb5-452a-b932-b8254fba3d49 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:23.624007 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d8f1aa6-8bb5-452a-b932-b8254fba3d49 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:23.624421 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d8f1aa6-8bb5-452a-b932-b8254fba3d49 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:23.823773 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1d8f1aa6-8bb5-452a-b932-b8254fba3d49 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:23.831987 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1d8f1aa6-8bb5-452a-b932-b8254fba3d49 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed" status: 200 len: 1520 microversion: 2.1 time: 0.221931 Aug 28 10:18:23.832606 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 181/341] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:23 2022] GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:18:24.053112 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-759f0cea-dfa5-4f0f-9fdf-0257a4769cb9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Flavor limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 28 10:18:24.053528 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-759f0cea-dfa5-4f0f-9fdf-0257a4769cb9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Image limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 28 10:18:24.053994 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-759f0cea-dfa5-4f0f-9fdf-0257a4769cb9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Flavor pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 28 10:18:24.054392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-759f0cea-dfa5-4f0f-9fdf-0257a4769cb9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Image pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 28 10:18:24.054800 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-759f0cea-dfa5-4f0f-9fdf-0257a4769cb9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 28 10:18:24.064377 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-759f0cea-dfa5-4f0f-9fdf-0257a4769cb9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:24.064888 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-759f0cea-dfa5-4f0f-9fdf-0257a4769cb9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:24.065383 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-759f0cea-dfa5-4f0f-9fdf-0257a4769cb9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:24.066100 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-759f0cea-dfa5-4f0f-9fdf-0257a4769cb9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:24.066548 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-759f0cea-dfa5-4f0f-9fdf-0257a4769cb9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:24.066966 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-759f0cea-dfa5-4f0f-9fdf-0257a4769cb9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:24.084229 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-759f0cea-dfa5-4f0f-9fdf-0257a4769cb9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Getting quotas for project 04c4f12270d54d5784bb9a12aced18c2. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:18:24.088370 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-759f0cea-dfa5-4f0f-9fdf-0257a4769cb9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Getting quotas for user 538b5483267549e6be369a653928b4b9 and project 04c4f12270d54d5784bb9a12aced18c2. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:18:24.100162 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-759f0cea-dfa5-4f0f-9fdf-0257a4769cb9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Going to run 1 instances... {{(pid=120664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 28 10:18:24.102553 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-759f0cea-dfa5-4f0f-9fdf-0257a4769cb9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 78c1fa2f-a973-4e1d-834a-c037b6272109] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2780c39b-8bd3-4e73-9669-2b2e29474f3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 28 10:18:24.159526 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-759f0cea-dfa5-4f0f-9fdf-0257a4769cb9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612891 Aug 28 10:18:24.160177 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 161/342] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Aug 28 10:18:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 28 10:18:24.171477 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-508012e5-1d83-4216-86bf-6a721006df88 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:24.172227 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-508012e5-1d83-4216-86bf-6a721006df88 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 78c1fa2f-a973-4e1d-834a-c037b6272109] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:24.226448 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-508012e5-1d83-4216-86bf-6a721006df88 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:24.234488 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-508012e5-1d83-4216-86bf-6a721006df88 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109" status: 200 len: 1218 microversion: 2.1 time: 0.066832 Aug 28 10:18:24.235067 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 182/343] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:24 2022] GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:24.857378 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-078ead14-e576-402c-b2d3-6c67bbeb536f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:24.858134 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-078ead14-e576-402c-b2d3-6c67bbeb536f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:24.865837 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-078ead14-e576-402c-b2d3-6c67bbeb536f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:24.866322 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-078ead14-e576-402c-b2d3-6c67bbeb536f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:24.866752 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-078ead14-e576-402c-b2d3-6c67bbeb536f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:24.867454 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-078ead14-e576-402c-b2d3-6c67bbeb536f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:24.870284 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-078ead14-e576-402c-b2d3-6c67bbeb536f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:24.870697 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-078ead14-e576-402c-b2d3-6c67bbeb536f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:25.063148 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-078ead14-e576-402c-b2d3-6c67bbeb536f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:25.067685 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-078ead14-e576-402c-b2d3-6c67bbeb536f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed" status: 200 len: 1520 microversion: 2.1 time: 0.215557 Aug 28 10:18:25.073462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 162/344] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:24 2022] GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:25.254920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fc668100-961c-4c37-886f-bc9b3290a3b6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:25.258599 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fc668100-961c-4c37-886f-bc9b3290a3b6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 78c1fa2f-a973-4e1d-834a-c037b6272109] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:25.265081 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fc668100-961c-4c37-886f-bc9b3290a3b6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:25.265741 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fc668100-961c-4c37-886f-bc9b3290a3b6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:25.266186 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fc668100-961c-4c37-886f-bc9b3290a3b6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:25.266937 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fc668100-961c-4c37-886f-bc9b3290a3b6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:25.267454 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fc668100-961c-4c37-886f-bc9b3290a3b6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:25.267937 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fc668100-961c-4c37-886f-bc9b3290a3b6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:25.336927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fc668100-961c-4c37-886f-bc9b3290a3b6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:25.352776 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fc668100-961c-4c37-886f-bc9b3290a3b6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109" status: 200 len: 1270 microversion: 2.1 time: 0.099980 Aug 28 10:18:25.352776 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 183/345] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:25 2022] GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109 => generated 1270 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:26.098457 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-5ff6eab1-1cd0-4e67-9270-2a65e43fe859 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:26.099394 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-5ff6eab1-1cd0-4e67-9270-2a65e43fe859 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:26.111318 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5ff6eab1-1cd0-4e67-9270-2a65e43fe859 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:26.112120 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5ff6eab1-1cd0-4e67-9270-2a65e43fe859 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:26.112772 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5ff6eab1-1cd0-4e67-9270-2a65e43fe859 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:26.113470 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5ff6eab1-1cd0-4e67-9270-2a65e43fe859 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:26.113920 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5ff6eab1-1cd0-4e67-9270-2a65e43fe859 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:26.114340 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5ff6eab1-1cd0-4e67-9270-2a65e43fe859 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:26.372343 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f9ac442a-6db9-4a57-a99c-30b84b3bdc64 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:26.373018 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f9ac442a-6db9-4a57-a99c-30b84b3bdc64 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 78c1fa2f-a973-4e1d-834a-c037b6272109] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:26.379722 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f9ac442a-6db9-4a57-a99c-30b84b3bdc64 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:26.380207 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f9ac442a-6db9-4a57-a99c-30b84b3bdc64 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:26.381117 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f9ac442a-6db9-4a57-a99c-30b84b3bdc64 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:26.381821 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f9ac442a-6db9-4a57-a99c-30b84b3bdc64 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:26.382289 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f9ac442a-6db9-4a57-a99c-30b84b3bdc64 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:26.382715 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f9ac442a-6db9-4a57-a99c-30b84b3bdc64 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:26.498456 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f9ac442a-6db9-4a57-a99c-30b84b3bdc64 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:26.513374 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f9ac442a-6db9-4a57-a99c-30b84b3bdc64 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109" status: 200 len: 1270 microversion: 2.1 time: 0.144902 Aug 28 10:18:26.513967 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 184/346] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:26 2022] GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109 => generated 1270 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:26.518509 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-5ff6eab1-1cd0-4e67-9270-2a65e43fe859 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:26.527945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-5ff6eab1-1cd0-4e67-9270-2a65e43fe859 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed" status: 200 len: 1520 microversion: 2.1 time: 0.435965 Aug 28 10:18:26.539452 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 163/347] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:26 2022] GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed => generated 1520 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:27.538561 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5905800d-9bae-467c-84b4-2680d32a410e tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:27.539527 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5905800d-9bae-467c-84b4-2680d32a410e tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 78c1fa2f-a973-4e1d-834a-c037b6272109] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:27.547516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5905800d-9bae-467c-84b4-2680d32a410e tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:27.548692 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5905800d-9bae-467c-84b4-2680d32a410e tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:27.550785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5905800d-9bae-467c-84b4-2680d32a410e tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:27.552383 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5905800d-9bae-467c-84b4-2680d32a410e tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:27.553266 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5905800d-9bae-467c-84b4-2680d32a410e tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:27.553935 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5905800d-9bae-467c-84b4-2680d32a410e tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:27.555762 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-164226d2-7e5a-4c83-8159-b8c4e1610590 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:27.556380 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-164226d2-7e5a-4c83-8159-b8c4e1610590 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:27.563141 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-164226d2-7e5a-4c83-8159-b8c4e1610590 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:27.563619 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-164226d2-7e5a-4c83-8159-b8c4e1610590 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:27.566658 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-164226d2-7e5a-4c83-8159-b8c4e1610590 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:27.567576 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-164226d2-7e5a-4c83-8159-b8c4e1610590 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:27.568340 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-164226d2-7e5a-4c83-8159-b8c4e1610590 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:27.569376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-164226d2-7e5a-4c83-8159-b8c4e1610590 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:27.642665 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5905800d-9bae-467c-84b4-2680d32a410e tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:27.650512 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5905800d-9bae-467c-84b4-2680d32a410e tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109" status: 200 len: 1278 microversion: 2.1 time: 0.116625 Aug 28 10:18:27.651097 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 185/348] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:27 2022] GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109 => generated 1278 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:27.795342 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-164226d2-7e5a-4c83-8159-b8c4e1610590 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:27.803638 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-164226d2-7e5a-4c83-8159-b8c4e1610590 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed" status: 200 len: 1520 microversion: 2.1 time: 0.251738 Aug 28 10:18:27.804234 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 164/349] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:27 2022] GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:28.671959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-31251ba9-b95d-4312-b68c-1aeca7c795f0 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:28.672606 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-31251ba9-b95d-4312-b68c-1aeca7c795f0 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 78c1fa2f-a973-4e1d-834a-c037b6272109] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:28.679037 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-31251ba9-b95d-4312-b68c-1aeca7c795f0 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:28.679519 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-31251ba9-b95d-4312-b68c-1aeca7c795f0 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:28.680656 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-31251ba9-b95d-4312-b68c-1aeca7c795f0 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:28.681627 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-31251ba9-b95d-4312-b68c-1aeca7c795f0 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:28.682149 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-31251ba9-b95d-4312-b68c-1aeca7c795f0 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:28.683078 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-31251ba9-b95d-4312-b68c-1aeca7c795f0 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:28.825269 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-a81b09d6-073a-4014-9972-c5e420bf8a7f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:28.826197 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-a81b09d6-073a-4014-9972-c5e420bf8a7f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:28.831506 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-31251ba9-b95d-4312-b68c-1aeca7c795f0 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:28.833296 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a81b09d6-073a-4014-9972-c5e420bf8a7f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:28.833865 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a81b09d6-073a-4014-9972-c5e420bf8a7f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:28.834549 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a81b09d6-073a-4014-9972-c5e420bf8a7f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:28.835340 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a81b09d6-073a-4014-9972-c5e420bf8a7f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:28.835903 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a81b09d6-073a-4014-9972-c5e420bf8a7f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:28.836442 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a81b09d6-073a-4014-9972-c5e420bf8a7f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:28.840807 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-31251ba9-b95d-4312-b68c-1aeca7c795f0 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109" status: 200 len: 1318 microversion: 2.1 time: 0.172747 Aug 28 10:18:28.841643 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 186/350] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:28 2022] GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:28.979487 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-a81b09d6-073a-4014-9972-c5e420bf8a7f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:28.987678 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-a81b09d6-073a-4014-9972-c5e420bf8a7f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed" status: 200 len: 1520 microversion: 2.1 time: 0.166452 Aug 28 10:18:28.988247 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 165/351] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:28 2022] GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:18:29.606485 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-982250df-f456-48cc-b009-ba2aafe36079 req-1d783c29-2084-473e-98a7-ad55b25e6442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78c1fa2f-a973-4e1d-834a-c037b6272109", "tag": "44d55a67-5c66-4b90-b2a4-3a07f3c92fdb"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:18:29.616276 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-982250df-f456-48cc-b009-ba2aafe36079 req-1d783c29-2084-473e-98a7-ad55b25e6442 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:29.617064 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-982250df-f456-48cc-b009-ba2aafe36079 req-1d783c29-2084-473e-98a7-ad55b25e6442 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:29.617776 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-982250df-f456-48cc-b009-ba2aafe36079 req-1d783c29-2084-473e-98a7-ad55b25e6442 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:29.630006 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-982250df-f456-48cc-b009-ba2aafe36079 req-1d783c29-2084-473e-98a7-ad55b25e6442 service nova] Creating event network-changed:44d55a67-5c66-4b90-b2a4-3a07f3c92fdb for instance 78c1fa2f-a973-4e1d-834a-c037b6272109 on hv-cinder-85200 Aug 28 10:18:29.635140 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-982250df-f456-48cc-b009-ba2aafe36079 req-1d783c29-2084-473e-98a7-ad55b25e6442 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032365 Aug 28 10:18:29.635741 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 187/352] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:18:29.867728 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-bf94fdf1-2511-4795-a492-7ed8f85a1e79 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:29.868421 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-bf94fdf1-2511-4795-a492-7ed8f85a1e79 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 78c1fa2f-a973-4e1d-834a-c037b6272109] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:29.875772 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-bf94fdf1-2511-4795-a492-7ed8f85a1e79 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:29.876367 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-bf94fdf1-2511-4795-a492-7ed8f85a1e79 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:29.876696 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-bf94fdf1-2511-4795-a492-7ed8f85a1e79 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:29.877378 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-bf94fdf1-2511-4795-a492-7ed8f85a1e79 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:29.877816 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-bf94fdf1-2511-4795-a492-7ed8f85a1e79 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:29.878225 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-bf94fdf1-2511-4795-a492-7ed8f85a1e79 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:30.009310 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-bf94fdf1-2511-4795-a492-7ed8f85a1e79 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:30.009771 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c84c0edc-976d-4ada-82ae-22e148c27636 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:30.010736 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c84c0edc-976d-4ada-82ae-22e148c27636 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:30.016964 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c84c0edc-976d-4ada-82ae-22e148c27636 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:30.017310 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-bf94fdf1-2511-4795-a492-7ed8f85a1e79 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109" status: 200 len: 1318 microversion: 2.1 time: 0.155011 Aug 28 10:18:30.017655 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c84c0edc-976d-4ada-82ae-22e148c27636 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:30.030175 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c84c0edc-976d-4ada-82ae-22e148c27636 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:30.030364 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 166/353] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:29 2022] GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:30.030481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c84c0edc-976d-4ada-82ae-22e148c27636 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:30.030481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c84c0edc-976d-4ada-82ae-22e148c27636 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:30.030481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c84c0edc-976d-4ada-82ae-22e148c27636 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:30.150141 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c84c0edc-976d-4ada-82ae-22e148c27636 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:30.160094 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c84c0edc-976d-4ada-82ae-22e148c27636 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed" status: 200 len: 1500 microversion: 2.1 time: 0.154730 Aug 28 10:18:30.160786 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 188/354] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:30 2022] GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed => generated 1500 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:18:30.181630 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-03230e76-a1be-4739-8412-f6fd379f7446 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "055e24a0-c33e-4b7b-a680-ffa83f5fed83"}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:18:30.184101 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-03230e76-a1be-4739-8412-f6fd379f7446 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:30.190136 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-03230e76-a1be-4739-8412-f6fd379f7446 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:30.190638 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-03230e76-a1be-4739-8412-f6fd379f7446 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:30.191057 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-03230e76-a1be-4739-8412-f6fd379f7446 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:30.191728 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-03230e76-a1be-4739-8412-f6fd379f7446 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:30.192163 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-03230e76-a1be-4739-8412-f6fd379f7446 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:30.192599 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-03230e76-a1be-4739-8412-f6fd379f7446 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:30.220631 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-03230e76-a1be-4739-8412-f6fd379f7446 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] HTTP exception thrown: Cannot 'attach_volume' instance c703c468-fcfc-41a1-ae56-4b9a516378ed while it is in vm_state rescued Aug 28 10:18:30.222731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-03230e76-a1be-4739-8412-f6fd379f7446 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Request method failure captured: Aug 28 10:18:30.222731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: POST /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed/os-volume_attachments HTTP/1.1 Aug 28 10:18:30.222731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:18:30.222731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:18:30.222731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:18:30.222731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 74 Aug 28 10:18:30.222731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:18:30.222731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:18:30.222731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:18:30.222731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:18:30.222731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0BdyAqhvO99cOM5hawKKYVu196vZNrBZRhFt1ByTfBso6IljPvRwmFtOxQ-5_REe3e3fIpeo_Uxe0JjEGytZ3lwxFlupsGmsBRkrCJVUAkjaIvPOzsCZzFrWjagztbQkpAi3Bsz_osgpmcHtCpoXF-xdis5QSWY4NN8aMRzRAADM90 Aug 28 10:18:30.222731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:18:30.222731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:18:30.222731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:18:30.222731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:18:30.222731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:18:30.222731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:18:30.222731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: 76d489fb3d144cc3abf03a842e70636d Aug 28 10:18:30.222731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-925139782 Aug 28 10:18:30.222731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:18:30.222731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:18:30.224343 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_76d489fb3d144cc3abf03a842e70636d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/76d489fb3d144cc3abf03a842e70636d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/76d489fb3d144cc3abf03a842e70636d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/76d489fb3d144cc3abf03a842e70636d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:18:30.224343 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-ServerRescueNegativeTestJSON-925139782 Aug 28 10:18:30.224343 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: 76d489fb3d144cc3abf03a842e70636d Aug 28 10:18:30.224343 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-925139782 Aug 28 10:18:30.224343 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-ServerRescueNegativeTestJSON-925139782-project Aug 28 10:18:30.224343 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:18:30.224343 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:18:30.224343 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: edbf26fde0254259a540f31139fc1a51 Aug 28 10:18:30.224343 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-ServerRescueNegativeTestJSON-925139782-project Aug 28 10:18:30.224343 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Aug 28 10:18:30.224343 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {"volumeAttachment": {"volumeId": "055e24a0-c33e-4b7b-a680-ffa83f5fed83"}} Aug 28 10:18:30.224343 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: > Aug 28 10:18:30.225210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Cannot 'attach_volume' instance c703c468-fcfc-41a1-ae56-4b9a516378ed while it is in vm_state rescued Aug 28 10:18:30.225210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'server_id': 'c703c468-fcfc-41a1-ae56-4b9a516378ed', 'body': {'volumeAttachment': {'volumeId': '055e24a0-c33e-4b7b-a680-ffa83f5fed83'}}} Aug 28 10:18:30.225210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:18:30.225210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:18:30.225210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 28 10:18:30.225210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 28 10:18:30.225210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 28 10:18:30.225210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 28 10:18:30.225210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 28 10:18:30.225210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 28 10:18:30.225210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c703c468-fcfc-41a1-ae56-4b9a516378ed in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 28 10:18:30.225210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:18:30.225210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:18:30.225210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:18:30.225210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:18:30.225210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:18:30.225210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:18:30.225210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:18:30.225210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:18:30.226539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:18:30.226539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:18:30.226539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 28 10:18:30.226539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 28 10:18:30.226539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 28 10:18:30.226539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 28 10:18:30.226539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 28 10:18:30.226539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 28 10:18:30.226539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 28 10:18:30.226539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 28 10:18:30.226539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 28 10:18:30.226539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 28 10:18:30.226539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c703c468-fcfc-41a1-ae56-4b9a516378ed while it is in vm_state rescued Aug 28 10:18:30.226539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:18:30.226539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:18:30.226539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:18:30.226539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:18:30.226539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:18:30.226539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:18:30.227828 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:18:30.227828 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:18:30.227828 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c703c468-fcfc-41a1-ae56-4b9a516378ed while it is in vm_state rescued Aug 28 10:18:30.227828 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:18:30.227828 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-03230e76-a1be-4739-8412-f6fd379f7446 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Returning 409 to user: Cannot 'attach_volume' instance c703c468-fcfc-41a1-ae56-4b9a516378ed while it is in vm_state rescued {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:18:30.227828 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-03230e76-a1be-4739-8412-f6fd379f7446 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "POST /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046623 Aug 28 10:18:30.227828 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 167/355] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Aug 28 10:18:30 2022] POST /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 28 10:18:30.233408 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-aed015df-5b33-4234-a517-2f9d73f6796c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:18:30.233954 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-aed015df-5b33-4234-a517-2f9d73f6796c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:30.239957 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aed015df-5b33-4234-a517-2f9d73f6796c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:30.240436 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aed015df-5b33-4234-a517-2f9d73f6796c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:30.240892 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aed015df-5b33-4234-a517-2f9d73f6796c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:30.241572 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aed015df-5b33-4234-a517-2f9d73f6796c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:30.242016 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aed015df-5b33-4234-a517-2f9d73f6796c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:30.242426 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aed015df-5b33-4234-a517-2f9d73f6796c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:30.317706 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-aed015df-5b33-4234-a517-2f9d73f6796c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "POST /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed/action" status: 202 len: 0 microversion: 2.1 time: 0.087945 Aug 28 10:18:30.318261 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 189/356] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Aug 28 10:18:30 2022] POST /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:18:30.326446 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-59bf1950-a7eb-4df5-a037-5dee2c766a17 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:30.327065 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-59bf1950-a7eb-4df5-a037-5dee2c766a17 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:30.333202 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-59bf1950-a7eb-4df5-a037-5dee2c766a17 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:30.333669 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-59bf1950-a7eb-4df5-a037-5dee2c766a17 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:30.334087 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-59bf1950-a7eb-4df5-a037-5dee2c766a17 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:30.334753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-59bf1950-a7eb-4df5-a037-5dee2c766a17 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:30.335190 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-59bf1950-a7eb-4df5-a037-5dee2c766a17 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:30.335596 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-59bf1950-a7eb-4df5-a037-5dee2c766a17 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:30.464432 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-59bf1950-a7eb-4df5-a037-5dee2c766a17 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:30.472346 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-59bf1950-a7eb-4df5-a037-5dee2c766a17 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed" status: 200 len: 1508 microversion: 2.1 time: 0.149798 Aug 28 10:18:30.472981 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 168/357] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:30 2022] GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:18:31.042428 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2e39993f-6248-41a1-9dc9-8c82e15858f7 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:31.043576 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2e39993f-6248-41a1-9dc9-8c82e15858f7 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 78c1fa2f-a973-4e1d-834a-c037b6272109] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:31.054929 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2e39993f-6248-41a1-9dc9-8c82e15858f7 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:31.055713 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2e39993f-6248-41a1-9dc9-8c82e15858f7 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:31.056421 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2e39993f-6248-41a1-9dc9-8c82e15858f7 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:31.057595 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2e39993f-6248-41a1-9dc9-8c82e15858f7 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:31.058337 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2e39993f-6248-41a1-9dc9-8c82e15858f7 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:31.059035 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2e39993f-6248-41a1-9dc9-8c82e15858f7 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:31.217060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2e39993f-6248-41a1-9dc9-8c82e15858f7 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:31.228304 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2e39993f-6248-41a1-9dc9-8c82e15858f7 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109" status: 200 len: 1318 microversion: 2.1 time: 0.193155 Aug 28 10:18:31.229052 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 190/358] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:31 2022] GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:31.496965 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-414157cd-7ebe-479f-afef-636d9868aac4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:31.497967 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-414157cd-7ebe-479f-afef-636d9868aac4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:31.507369 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-414157cd-7ebe-479f-afef-636d9868aac4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:31.507835 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-414157cd-7ebe-479f-afef-636d9868aac4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:31.508259 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-414157cd-7ebe-479f-afef-636d9868aac4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:31.509004 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-414157cd-7ebe-479f-afef-636d9868aac4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:31.509446 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-414157cd-7ebe-479f-afef-636d9868aac4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:31.509857 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-414157cd-7ebe-479f-afef-636d9868aac4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:31.641669 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-414157cd-7ebe-479f-afef-636d9868aac4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:31.649608 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-414157cd-7ebe-479f-afef-636d9868aac4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed" status: 200 len: 1508 microversion: 2.1 time: 0.159195 Aug 28 10:18:31.650174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 169/359] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:31 2022] GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:32.253405 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-edf9f016-dc8e-4ea8-b550-241f85a8ab67 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:32.254486 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-edf9f016-dc8e-4ea8-b550-241f85a8ab67 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 78c1fa2f-a973-4e1d-834a-c037b6272109] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:32.260958 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-edf9f016-dc8e-4ea8-b550-241f85a8ab67 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:32.261434 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-edf9f016-dc8e-4ea8-b550-241f85a8ab67 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:32.261853 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-edf9f016-dc8e-4ea8-b550-241f85a8ab67 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:32.262523 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-edf9f016-dc8e-4ea8-b550-241f85a8ab67 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:32.262962 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-edf9f016-dc8e-4ea8-b550-241f85a8ab67 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:32.263372 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-edf9f016-dc8e-4ea8-b550-241f85a8ab67 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:32.404278 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-edf9f016-dc8e-4ea8-b550-241f85a8ab67 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:32.411985 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-edf9f016-dc8e-4ea8-b550-241f85a8ab67 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109" status: 200 len: 1318 microversion: 2.1 time: 0.165099 Aug 28 10:18:32.412598 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 191/360] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:32 2022] GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:32.671308 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-fa2e97f5-2665-48ca-8faf-420030c0b151 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:32.671914 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-fa2e97f5-2665-48ca-8faf-420030c0b151 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:32.678370 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fa2e97f5-2665-48ca-8faf-420030c0b151 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:32.678843 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fa2e97f5-2665-48ca-8faf-420030c0b151 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:32.679263 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fa2e97f5-2665-48ca-8faf-420030c0b151 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:32.679968 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fa2e97f5-2665-48ca-8faf-420030c0b151 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:32.680390 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fa2e97f5-2665-48ca-8faf-420030c0b151 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:32.680842 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fa2e97f5-2665-48ca-8faf-420030c0b151 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:32.811980 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-fa2e97f5-2665-48ca-8faf-420030c0b151 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:32.820536 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-fa2e97f5-2665-48ca-8faf-420030c0b151 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed" status: 200 len: 1508 microversion: 2.1 time: 0.153308 Aug 28 10:18:32.821134 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 170/361] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:32 2022] GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:33.432243 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6fb665bf-d2c8-4f3a-88cb-b2ee8aead8c7 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:33.432873 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6fb665bf-d2c8-4f3a-88cb-b2ee8aead8c7 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 78c1fa2f-a973-4e1d-834a-c037b6272109] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:33.438914 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fb665bf-d2c8-4f3a-88cb-b2ee8aead8c7 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:33.439385 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fb665bf-d2c8-4f3a-88cb-b2ee8aead8c7 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:33.439822 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fb665bf-d2c8-4f3a-88cb-b2ee8aead8c7 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:33.440472 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fb665bf-d2c8-4f3a-88cb-b2ee8aead8c7 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:33.440929 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fb665bf-d2c8-4f3a-88cb-b2ee8aead8c7 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:33.441336 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fb665bf-d2c8-4f3a-88cb-b2ee8aead8c7 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:33.459860 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:33.582267 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6fb665bf-d2c8-4f3a-88cb-b2ee8aead8c7 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:33.590663 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6fb665bf-d2c8-4f3a-88cb-b2ee8aead8c7 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109" status: 200 len: 1318 microversion: 2.1 time: 0.162286 Aug 28 10:18:33.591246 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 192/362] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:33 2022] GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:33.842747 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-ba0c161e-fcd4-42e6-8419-60d94968a276 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:33.843447 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-ba0c161e-fcd4-42e6-8419-60d94968a276 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:33.851271 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ba0c161e-fcd4-42e6-8419-60d94968a276 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:33.851751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ba0c161e-fcd4-42e6-8419-60d94968a276 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:33.852182 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ba0c161e-fcd4-42e6-8419-60d94968a276 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:33.852908 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ba0c161e-fcd4-42e6-8419-60d94968a276 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:33.853363 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ba0c161e-fcd4-42e6-8419-60d94968a276 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:33.853779 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ba0c161e-fcd4-42e6-8419-60d94968a276 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:33.987401 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-ba0c161e-fcd4-42e6-8419-60d94968a276 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:33.995513 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-ba0c161e-fcd4-42e6-8419-60d94968a276 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed" status: 200 len: 1508 microversion: 2.1 time: 0.157828 Aug 28 10:18:33.996114 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 171/363] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:33 2022] GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:34.611399 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6a6d4323-cd9a-4f18-81e9-d5c674c7490b tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:34.612026 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6a6d4323-cd9a-4f18-81e9-d5c674c7490b tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 78c1fa2f-a973-4e1d-834a-c037b6272109] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:34.613947 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:34.619153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a6d4323-cd9a-4f18-81e9-d5c674c7490b tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:34.619608 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a6d4323-cd9a-4f18-81e9-d5c674c7490b tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:34.620032 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a6d4323-cd9a-4f18-81e9-d5c674c7490b tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:34.620731 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a6d4323-cd9a-4f18-81e9-d5c674c7490b tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:34.621154 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a6d4323-cd9a-4f18-81e9-d5c674c7490b tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:34.621568 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a6d4323-cd9a-4f18-81e9-d5c674c7490b tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:34.762041 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6a6d4323-cd9a-4f18-81e9-d5c674c7490b tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:34.774029 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6a6d4323-cd9a-4f18-81e9-d5c674c7490b tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109" status: 200 len: 1318 microversion: 2.1 time: 0.166243 Aug 28 10:18:34.774835 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 193/364] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:34 2022] GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:35.017333 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-2284f58d-90c5-46c8-89bd-05d1970c2619 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:35.018055 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-2284f58d-90c5-46c8-89bd-05d1970c2619 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:35.020403 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=2 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:35.021089 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=6 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:35.027756 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2284f58d-90c5-46c8-89bd-05d1970c2619 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:35.028234 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2284f58d-90c5-46c8-89bd-05d1970c2619 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:35.028696 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2284f58d-90c5-46c8-89bd-05d1970c2619 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:35.029648 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2284f58d-90c5-46c8-89bd-05d1970c2619 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:35.030091 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2284f58d-90c5-46c8-89bd-05d1970c2619 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:35.030503 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2284f58d-90c5-46c8-89bd-05d1970c2619 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:35.034905 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:35.174089 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-2284f58d-90c5-46c8-89bd-05d1970c2619 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:35.182201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-2284f58d-90c5-46c8-89bd-05d1970c2619 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed" status: 200 len: 1508 microversion: 2.1 time: 0.169594 Aug 28 10:18:35.182737 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 172/365] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:35 2022] GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:35.794813 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5eab163f-5290-429a-bd16-575522776f30 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:35.795521 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5eab163f-5290-429a-bd16-575522776f30 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 78c1fa2f-a973-4e1d-834a-c037b6272109] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:35.802177 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5eab163f-5290-429a-bd16-575522776f30 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:35.802758 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5eab163f-5290-429a-bd16-575522776f30 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:35.803104 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5eab163f-5290-429a-bd16-575522776f30 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:35.803891 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5eab163f-5290-429a-bd16-575522776f30 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:35.804335 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5eab163f-5290-429a-bd16-575522776f30 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:35.804787 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5eab163f-5290-429a-bd16-575522776f30 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:35.935309 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5eab163f-5290-429a-bd16-575522776f30 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:35.943230 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5eab163f-5290-429a-bd16-575522776f30 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109" status: 200 len: 1318 microversion: 2.1 time: 0.152384 Aug 28 10:18:35.944027 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 194/366] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:35 2022] GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:36.205192 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-51ec18e1-1555-49a5-b25f-ae7762f10f23 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:36.206414 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-51ec18e1-1555-49a5-b25f-ae7762f10f23 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:36.213023 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-51ec18e1-1555-49a5-b25f-ae7762f10f23 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:36.213506 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-51ec18e1-1555-49a5-b25f-ae7762f10f23 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:36.213928 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-51ec18e1-1555-49a5-b25f-ae7762f10f23 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:36.214830 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-51ec18e1-1555-49a5-b25f-ae7762f10f23 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:36.215276 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-51ec18e1-1555-49a5-b25f-ae7762f10f23 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:36.215695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-51ec18e1-1555-49a5-b25f-ae7762f10f23 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:36.348160 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-51ec18e1-1555-49a5-b25f-ae7762f10f23 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:36.356295 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-51ec18e1-1555-49a5-b25f-ae7762f10f23 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed" status: 200 len: 1508 microversion: 2.1 time: 0.156535 Aug 28 10:18:36.356924 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 173/367] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:36 2022] GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:36.972308 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a873d6fd-8df1-44f9-92a9-c4549a3aac90 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:36.973115 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a873d6fd-8df1-44f9-92a9-c4549a3aac90 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 78c1fa2f-a973-4e1d-834a-c037b6272109] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:36.980782 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a873d6fd-8df1-44f9-92a9-c4549a3aac90 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:36.981258 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a873d6fd-8df1-44f9-92a9-c4549a3aac90 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:36.981679 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a873d6fd-8df1-44f9-92a9-c4549a3aac90 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:36.982408 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a873d6fd-8df1-44f9-92a9-c4549a3aac90 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:36.982848 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a873d6fd-8df1-44f9-92a9-c4549a3aac90 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:36.983251 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a873d6fd-8df1-44f9-92a9-c4549a3aac90 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:37.123216 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a873d6fd-8df1-44f9-92a9-c4549a3aac90 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:37.132170 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a873d6fd-8df1-44f9-92a9-c4549a3aac90 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109" status: 200 len: 1318 microversion: 2.1 time: 0.165374 Aug 28 10:18:37.132868 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 195/368] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:36 2022] GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:37.380177 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-5aec1676-d62f-4383-8cc0-08b67bfb358f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:37.381005 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-5aec1676-d62f-4383-8cc0-08b67bfb358f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:37.390527 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5aec1676-d62f-4383-8cc0-08b67bfb358f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:37.391255 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5aec1676-d62f-4383-8cc0-08b67bfb358f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:37.391867 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5aec1676-d62f-4383-8cc0-08b67bfb358f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:37.392902 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5aec1676-d62f-4383-8cc0-08b67bfb358f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:37.393545 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5aec1676-d62f-4383-8cc0-08b67bfb358f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:37.394146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5aec1676-d62f-4383-8cc0-08b67bfb358f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:37.533874 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-5aec1676-d62f-4383-8cc0-08b67bfb358f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:37.542250 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-5aec1676-d62f-4383-8cc0-08b67bfb358f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed" status: 200 len: 1514 microversion: 2.1 time: 0.167753 Aug 28 10:18:37.542832 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 174/369] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:37 2022] GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:37.668260 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-e4d1e128-9851-4397-8e39-e7936e5883d7 req-844bb52c-52bd-4bd3-8974-dc2667e612cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c1fa2f-a973-4e1d-834a-c037b6272109", "name": "network-vif-plugged", "status": "completed", "tag": "44d55a67-5c66-4b90-b2a4-3a07f3c92fdb"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:18:37.679301 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-e4d1e128-9851-4397-8e39-e7936e5883d7 req-844bb52c-52bd-4bd3-8974-dc2667e612cf service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:37.680585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-e4d1e128-9851-4397-8e39-e7936e5883d7 req-844bb52c-52bd-4bd3-8974-dc2667e612cf service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:37.681228 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-e4d1e128-9851-4397-8e39-e7936e5883d7 req-844bb52c-52bd-4bd3-8974-dc2667e612cf service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:37.695571 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-e4d1e128-9851-4397-8e39-e7936e5883d7 req-844bb52c-52bd-4bd3-8974-dc2667e612cf service nova] Creating event network-vif-plugged:44d55a67-5c66-4b90-b2a4-3a07f3c92fdb for instance 78c1fa2f-a973-4e1d-834a-c037b6272109 on hv-cinder-85200 Aug 28 10:18:37.702880 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-e4d1e128-9851-4397-8e39-e7936e5883d7 req-844bb52c-52bd-4bd3-8974-dc2667e612cf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038891 Aug 28 10:18:37.703489 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 196/370] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:18:38.154615 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-33a80b3a-58ec-44ac-89d6-27f99e8246d5 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:38.155313 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-33a80b3a-58ec-44ac-89d6-27f99e8246d5 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 78c1fa2f-a973-4e1d-834a-c037b6272109] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:38.161761 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-33a80b3a-58ec-44ac-89d6-27f99e8246d5 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:38.162242 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-33a80b3a-58ec-44ac-89d6-27f99e8246d5 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:38.162701 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-33a80b3a-58ec-44ac-89d6-27f99e8246d5 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:38.163384 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-33a80b3a-58ec-44ac-89d6-27f99e8246d5 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:38.163840 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-33a80b3a-58ec-44ac-89d6-27f99e8246d5 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:38.164631 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-33a80b3a-58ec-44ac-89d6-27f99e8246d5 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:38.299464 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-33a80b3a-58ec-44ac-89d6-27f99e8246d5 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:38.310931 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-33a80b3a-58ec-44ac-89d6-27f99e8246d5 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109" status: 200 len: 1318 microversion: 2.1 time: 0.160099 Aug 28 10:18:38.311669 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 175/371] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:38 2022] GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:38.920437 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f44d695e-2daa-4139-8e96-789c646d3a28 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Action: 'create', calling method: .version_select at 0x7f7a1c3c0dc0>, body: {"keypair": {"name": "tempest-keypair-1399682061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjwf8oKzcDqjNOXtw4Eiu7f+p/ZiFBksQYfWDAmP1RXteTQzBWtMZ82E24e/cDZ3QHNQjfMBQNSrOat0/R8Axbophq4pjvKxCn2bPNebBM0IDFwtbH39lvdW2a/YcQg2A=="}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:18:38.939515 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-f44d695e-2daa-4139-8e96-789c646d3a28 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Getting quotas for project 76d489fb3d144cc3abf03a842e70636d. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:18:38.943734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-f44d695e-2daa-4139-8e96-789c646d3a28 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Getting quotas for user edbf26fde0254259a540f31139fc1a51 and project 76d489fb3d144cc3abf03a842e70636d. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:18:38.969837 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f44d695e-2daa-4139-8e96-789c646d3a28 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054188 Aug 28 10:18:38.970431 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 197/372] 10.222.0.40 () {60 vars in 1159 bytes} [Sun Aug 28 10:18:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:18:39.335662 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-06cde871-8817-4908-bec7-bbe059d86918 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:39.336258 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-06cde871-8817-4908-bec7-bbe059d86918 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 78c1fa2f-a973-4e1d-834a-c037b6272109] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:39.342840 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-06cde871-8817-4908-bec7-bbe059d86918 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:39.343321 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-06cde871-8817-4908-bec7-bbe059d86918 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:39.343730 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-06cde871-8817-4908-bec7-bbe059d86918 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:39.344421 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-06cde871-8817-4908-bec7-bbe059d86918 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:39.344890 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-06cde871-8817-4908-bec7-bbe059d86918 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:39.345490 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-06cde871-8817-4908-bec7-bbe059d86918 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:39.482857 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-06cde871-8817-4908-bec7-bbe059d86918 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:39.490454 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-06cde871-8817-4908-bec7-bbe059d86918 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109" status: 200 len: 1318 microversion: 2.1 time: 0.159448 Aug 28 10:18:39.491024 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 176/373] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:39 2022] GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:40.232983 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7725958e-9af1-4b60-8bfb-728108662085 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1411455921", "imageRef": "2780c39b-8bd3-4e73-9669-2b2e29474f3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93556dbd-33c6-4140-9730-09404394c1cf"}], "security_groups": [{"name": "tempest-securitygroup--394770863"}], "key_name": "tempest-keypair-1399682061", "user_data": "}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:18:40.340902 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-7725958e-9af1-4b60-8bfb-728108662085 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] validate_networks() for [('93556dbd-33c6-4140-9730-09404394c1cf', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 28 10:18:40.511136 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-993cb52a-dd69-460b-ba56-07fe465c8d7c tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:40.511763 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-993cb52a-dd69-460b-ba56-07fe465c8d7c tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 78c1fa2f-a973-4e1d-834a-c037b6272109] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:40.519790 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-993cb52a-dd69-460b-ba56-07fe465c8d7c tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:40.520269 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-993cb52a-dd69-460b-ba56-07fe465c8d7c tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:40.520747 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-993cb52a-dd69-460b-ba56-07fe465c8d7c tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:40.521434 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-993cb52a-dd69-460b-ba56-07fe465c8d7c tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:40.521877 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-993cb52a-dd69-460b-ba56-07fe465c8d7c tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:40.522288 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-993cb52a-dd69-460b-ba56-07fe465c8d7c tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:40.749709 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-993cb52a-dd69-460b-ba56-07fe465c8d7c tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:40.757896 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-993cb52a-dd69-460b-ba56-07fe465c8d7c tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109" status: 200 len: 1508 microversion: 2.1 time: 0.250762 Aug 28 10:18:40.758474 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 177/374] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:40 2022] GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109 => generated 1508 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:18:40.789549 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-7725958e-9af1-4b60-8bfb-728108662085 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 28 10:18:40.789963 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-7725958e-9af1-4b60-8bfb-728108662085 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 28 10:18:40.790423 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-7725958e-9af1-4b60-8bfb-728108662085 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 28 10:18:40.790932 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-7725958e-9af1-4b60-8bfb-728108662085 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 28 10:18:40.791329 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-7725958e-9af1-4b60-8bfb-728108662085 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 28 10:18:40.800539 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7725958e-9af1-4b60-8bfb-728108662085 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:40.801138 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7725958e-9af1-4b60-8bfb-728108662085 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:40.801602 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7725958e-9af1-4b60-8bfb-728108662085 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:40.802245 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7725958e-9af1-4b60-8bfb-728108662085 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:40.802803 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7725958e-9af1-4b60-8bfb-728108662085 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:40.803214 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7725958e-9af1-4b60-8bfb-728108662085 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:40.820662 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-7725958e-9af1-4b60-8bfb-728108662085 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Getting quotas for project 76d489fb3d144cc3abf03a842e70636d. Resources: {'instances', 'cores', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:18:40.824676 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-7725958e-9af1-4b60-8bfb-728108662085 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Getting quotas for user edbf26fde0254259a540f31139fc1a51 and project 76d489fb3d144cc3abf03a842e70636d. Resources: {'instances', 'cores', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:18:40.836045 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7725958e-9af1-4b60-8bfb-728108662085 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 28 10:18:40.838470 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7725958e-9af1-4b60-8bfb-728108662085 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2780c39b-8bd3-4e73-9669-2b2e29474f3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 28 10:18:40.887383 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7725958e-9af1-4b60-8bfb-728108662085 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.658861 Aug 28 10:18:40.887998 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 198/375] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Aug 28 10:18:40 2022] POST /compute/v2.1/servers => generated 408 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 28 10:18:40.899416 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-dddd6e17-a135-478e-80e5-c9cf76761347 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:40.900112 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-dddd6e17-a135-478e-80e5-c9cf76761347 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:40.903236 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:40.966913 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-dddd6e17-a135-478e-80e5-c9cf76761347 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:40.974716 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-dddd6e17-a135-478e-80e5-c9cf76761347 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1246 microversion: 2.1 time: 0.079792 Aug 28 10:18:40.975294 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 178/376] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:40 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1246 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:41.995365 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-59b3eb41-d697-49bf-90b9-1dea92f2b641 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:41.995972 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-59b3eb41-d697-49bf-90b9-1dea92f2b641 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:42.002825 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-59b3eb41-d697-49bf-90b9-1dea92f2b641 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:42.003306 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-59b3eb41-d697-49bf-90b9-1dea92f2b641 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:42.003730 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-59b3eb41-d697-49bf-90b9-1dea92f2b641 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:42.004407 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-59b3eb41-d697-49bf-90b9-1dea92f2b641 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:42.004893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-59b3eb41-d697-49bf-90b9-1dea92f2b641 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:42.005382 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-59b3eb41-d697-49bf-90b9-1dea92f2b641 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:42.071126 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-59b3eb41-d697-49bf-90b9-1dea92f2b641 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:42.082946 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-59b3eb41-d697-49bf-90b9-1dea92f2b641 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1298 microversion: 2.1 time: 0.091479 Aug 28 10:18:42.083817 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 199/377] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:41 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:43.105578 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-de0736da-d202-42e9-a3e1-e7b31d07e0fc tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:43.106407 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-de0736da-d202-42e9-a3e1-e7b31d07e0fc tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:43.113785 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-de0736da-d202-42e9-a3e1-e7b31d07e0fc tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:43.114368 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-de0736da-d202-42e9-a3e1-e7b31d07e0fc tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:43.114858 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-de0736da-d202-42e9-a3e1-e7b31d07e0fc tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:43.115597 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-de0736da-d202-42e9-a3e1-e7b31d07e0fc tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:43.116116 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-de0736da-d202-42e9-a3e1-e7b31d07e0fc tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:43.116623 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-de0736da-d202-42e9-a3e1-e7b31d07e0fc tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:43.262410 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-de0736da-d202-42e9-a3e1-e7b31d07e0fc tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:43.273715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-de0736da-d202-42e9-a3e1-e7b31d07e0fc tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1371 microversion: 2.1 time: 0.172215 Aug 28 10:18:43.274308 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 179/378] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:43 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:44.022108 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-b79b0759-cd6b-4cec-b25a-34fe2340994b req-6e57d9e0-23ee-4e25-bc1f-26d35034c090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c652c0fc-a515-4755-9eb4-8d46727fe990", "tag": "3db4dcbc-3ec6-4d01-8d04-71f8a8b8b4b0"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:18:44.032079 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-b79b0759-cd6b-4cec-b25a-34fe2340994b req-6e57d9e0-23ee-4e25-bc1f-26d35034c090 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:44.032757 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-b79b0759-cd6b-4cec-b25a-34fe2340994b req-6e57d9e0-23ee-4e25-bc1f-26d35034c090 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:44.033244 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-b79b0759-cd6b-4cec-b25a-34fe2340994b req-6e57d9e0-23ee-4e25-bc1f-26d35034c090 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:44.044841 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-b79b0759-cd6b-4cec-b25a-34fe2340994b req-6e57d9e0-23ee-4e25-bc1f-26d35034c090 service nova] Creating event network-changed:3db4dcbc-3ec6-4d01-8d04-71f8a8b8b4b0 for instance c652c0fc-a515-4755-9eb4-8d46727fe990 on hv-cinder-85200 Aug 28 10:18:44.049712 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-b79b0759-cd6b-4cec-b25a-34fe2340994b req-6e57d9e0-23ee-4e25-bc1f-26d35034c090 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031327 Aug 28 10:18:44.050331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 200/379] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:18:44.294671 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-82eabd2c-dc79-4057-bcd7-7ace5ca8ce27 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:44.295267 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-82eabd2c-dc79-4057-bcd7-7ace5ca8ce27 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:44.302105 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-82eabd2c-dc79-4057-bcd7-7ace5ca8ce27 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:44.302644 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-82eabd2c-dc79-4057-bcd7-7ace5ca8ce27 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:44.303059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-82eabd2c-dc79-4057-bcd7-7ace5ca8ce27 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:44.303749 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-82eabd2c-dc79-4057-bcd7-7ace5ca8ce27 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:44.304191 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-82eabd2c-dc79-4057-bcd7-7ace5ca8ce27 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:44.304636 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-82eabd2c-dc79-4057-bcd7-7ace5ca8ce27 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:44.451288 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-82eabd2c-dc79-4057-bcd7-7ace5ca8ce27 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:44.459669 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-82eabd2c-dc79-4057-bcd7-7ace5ca8ce27 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1371 microversion: 2.1 time: 0.168868 Aug 28 10:18:44.460237 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 180/380] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:44 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:45.481027 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-353f04b2-38f7-4b30-aab0-f5b3cfe045cb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:45.481711 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-353f04b2-38f7-4b30-aab0-f5b3cfe045cb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:45.488597 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-353f04b2-38f7-4b30-aab0-f5b3cfe045cb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:45.489075 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-353f04b2-38f7-4b30-aab0-f5b3cfe045cb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:45.489502 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-353f04b2-38f7-4b30-aab0-f5b3cfe045cb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:45.490187 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-353f04b2-38f7-4b30-aab0-f5b3cfe045cb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:45.490623 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-353f04b2-38f7-4b30-aab0-f5b3cfe045cb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:45.491041 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-353f04b2-38f7-4b30-aab0-f5b3cfe045cb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:45.630749 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-353f04b2-38f7-4b30-aab0-f5b3cfe045cb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:45.638800 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-353f04b2-38f7-4b30-aab0-f5b3cfe045cb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1371 microversion: 2.1 time: 0.162126 Aug 28 10:18:45.639340 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 201/381] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:45 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:46.659636 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-5c2f64ae-6ce5-49fe-b770-15ebdb95bdab tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:46.660205 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-5c2f64ae-6ce5-49fe-b770-15ebdb95bdab tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:46.667742 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5c2f64ae-6ce5-49fe-b770-15ebdb95bdab tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:46.668214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5c2f64ae-6ce5-49fe-b770-15ebdb95bdab tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:46.668672 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5c2f64ae-6ce5-49fe-b770-15ebdb95bdab tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:46.669349 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5c2f64ae-6ce5-49fe-b770-15ebdb95bdab tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:46.669783 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5c2f64ae-6ce5-49fe-b770-15ebdb95bdab tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:46.670378 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5c2f64ae-6ce5-49fe-b770-15ebdb95bdab tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:46.805038 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-5c2f64ae-6ce5-49fe-b770-15ebdb95bdab tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:46.814973 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-5c2f64ae-6ce5-49fe-b770-15ebdb95bdab tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1371 microversion: 2.1 time: 0.158982 Aug 28 10:18:46.815756 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 181/382] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:46 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:47.839421 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e7be1c8e-980c-4a0a-bf25-618093ed9335 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:47.840093 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e7be1c8e-980c-4a0a-bf25-618093ed9335 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:47.842181 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:47.848212 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e7be1c8e-980c-4a0a-bf25-618093ed9335 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:47.848720 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e7be1c8e-980c-4a0a-bf25-618093ed9335 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:47.849152 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e7be1c8e-980c-4a0a-bf25-618093ed9335 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:47.849859 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e7be1c8e-980c-4a0a-bf25-618093ed9335 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:47.850311 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e7be1c8e-980c-4a0a-bf25-618093ed9335 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:47.850728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e7be1c8e-980c-4a0a-bf25-618093ed9335 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:48.129447 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e7be1c8e-980c-4a0a-bf25-618093ed9335 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:48.139660 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e7be1c8e-980c-4a0a-bf25-618093ed9335 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1371 microversion: 2.1 time: 0.303962 Aug 28 10:18:48.140577 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 202/383] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:47 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:49.160927 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-a2ca0c3c-532a-44cf-9491-490aa2ac0748 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:49.161535 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-a2ca0c3c-532a-44cf-9491-490aa2ac0748 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:49.169295 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a2ca0c3c-532a-44cf-9491-490aa2ac0748 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:49.169810 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a2ca0c3c-532a-44cf-9491-490aa2ac0748 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:49.170268 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a2ca0c3c-532a-44cf-9491-490aa2ac0748 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:49.170973 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a2ca0c3c-532a-44cf-9491-490aa2ac0748 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:49.171420 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a2ca0c3c-532a-44cf-9491-490aa2ac0748 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:49.171841 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a2ca0c3c-532a-44cf-9491-490aa2ac0748 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:49.311707 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-a2ca0c3c-532a-44cf-9491-490aa2ac0748 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:49.320081 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-a2ca0c3c-532a-44cf-9491-490aa2ac0748 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1371 microversion: 2.1 time: 0.163044 Aug 28 10:18:49.320733 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 182/384] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:49 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:50.341887 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-11a1e6ed-157c-41f5-82d0-626ed3bc5c17 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:50.342500 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-11a1e6ed-157c-41f5-82d0-626ed3bc5c17 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:50.349460 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11a1e6ed-157c-41f5-82d0-626ed3bc5c17 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:50.349937 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11a1e6ed-157c-41f5-82d0-626ed3bc5c17 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:50.350366 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11a1e6ed-157c-41f5-82d0-626ed3bc5c17 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:50.351080 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11a1e6ed-157c-41f5-82d0-626ed3bc5c17 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:50.351521 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11a1e6ed-157c-41f5-82d0-626ed3bc5c17 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:50.351928 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11a1e6ed-157c-41f5-82d0-626ed3bc5c17 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:50.497041 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-11a1e6ed-157c-41f5-82d0-626ed3bc5c17 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:50.505686 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-11a1e6ed-157c-41f5-82d0-626ed3bc5c17 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1371 microversion: 2.1 time: 0.168377 Aug 28 10:18:50.506278 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 203/385] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:50 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:51.530517 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4a6bf47d-6ef3-466d-8197-c089525e2890 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:51.531473 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4a6bf47d-6ef3-466d-8197-c089525e2890 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:51.533998 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=2 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:51.539817 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4a6bf47d-6ef3-466d-8197-c089525e2890 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:51.540302 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4a6bf47d-6ef3-466d-8197-c089525e2890 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:51.540763 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4a6bf47d-6ef3-466d-8197-c089525e2890 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:51.541454 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4a6bf47d-6ef3-466d-8197-c089525e2890 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:51.541896 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4a6bf47d-6ef3-466d-8197-c089525e2890 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:51.542315 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4a6bf47d-6ef3-466d-8197-c089525e2890 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:51.674530 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4a6bf47d-6ef3-466d-8197-c089525e2890 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:51.682564 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4a6bf47d-6ef3-466d-8197-c089525e2890 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1371 microversion: 2.1 time: 0.158761 Aug 28 10:18:51.683134 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 183/386] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:51 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:52.082602 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-35d6b934-cc47-4db5-ade5-0c0146eeff5c req-8eb30d4c-a55f-4347-9519-41e6830ad058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c652c0fc-a515-4755-9eb4-8d46727fe990", "name": "network-vif-plugged", "status": "completed", "tag": "3db4dcbc-3ec6-4d01-8d04-71f8a8b8b4b0"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:18:52.087463 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:52.088355 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=10 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:52.093987 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-35d6b934-cc47-4db5-ade5-0c0146eeff5c req-8eb30d4c-a55f-4347-9519-41e6830ad058 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:52.094458 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-35d6b934-cc47-4db5-ade5-0c0146eeff5c req-8eb30d4c-a55f-4347-9519-41e6830ad058 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:52.094872 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-35d6b934-cc47-4db5-ade5-0c0146eeff5c req-8eb30d4c-a55f-4347-9519-41e6830ad058 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:52.106285 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-35d6b934-cc47-4db5-ade5-0c0146eeff5c req-8eb30d4c-a55f-4347-9519-41e6830ad058 service nova] Creating event network-vif-plugged:3db4dcbc-3ec6-4d01-8d04-71f8a8b8b4b0 for instance c652c0fc-a515-4755-9eb4-8d46727fe990 on hv-cinder-85200 Aug 28 10:18:52.111908 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-35d6b934-cc47-4db5-ade5-0c0146eeff5c req-8eb30d4c-a55f-4347-9519-41e6830ad058 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033095 Aug 28 10:18:52.112809 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 204/387] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:18:52.705813 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-da0c44a5-e3f1-49cb-98c8-3b1416499dd0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:52.706491 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-da0c44a5-e3f1-49cb-98c8-3b1416499dd0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:52.713822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-da0c44a5-e3f1-49cb-98c8-3b1416499dd0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:52.714296 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-da0c44a5-e3f1-49cb-98c8-3b1416499dd0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:52.714721 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-da0c44a5-e3f1-49cb-98c8-3b1416499dd0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:52.715597 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-da0c44a5-e3f1-49cb-98c8-3b1416499dd0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:52.716208 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-da0c44a5-e3f1-49cb-98c8-3b1416499dd0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:52.717770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-da0c44a5-e3f1-49cb-98c8-3b1416499dd0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:52.850870 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-da0c44a5-e3f1-49cb-98c8-3b1416499dd0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:52.858751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-da0c44a5-e3f1-49cb-98c8-3b1416499dd0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1371 microversion: 2.1 time: 0.158798 Aug 28 10:18:52.859324 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 184/388] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:52 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:53.884768 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f438898d-5d8e-44c6-8044-1fd0f1ea89ef tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:53.884768 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f438898d-5d8e-44c6-8044-1fd0f1ea89ef tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:53.887916 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f438898d-5d8e-44c6-8044-1fd0f1ea89ef tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:53.888401 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f438898d-5d8e-44c6-8044-1fd0f1ea89ef tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:53.888924 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f438898d-5d8e-44c6-8044-1fd0f1ea89ef tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:53.889615 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f438898d-5d8e-44c6-8044-1fd0f1ea89ef tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:53.890063 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f438898d-5d8e-44c6-8044-1fd0f1ea89ef tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:53.890483 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f438898d-5d8e-44c6-8044-1fd0f1ea89ef tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:54.022938 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f438898d-5d8e-44c6-8044-1fd0f1ea89ef tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:54.031205 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f438898d-5d8e-44c6-8044-1fd0f1ea89ef tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1371 microversion: 2.1 time: 0.154909 Aug 28 10:18:54.031852 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 205/389] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:53 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:55.051536 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-13b452b5-5b6e-4041-aa10-fcc7367d7e6f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:55.052219 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-13b452b5-5b6e-4041-aa10-fcc7367d7e6f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:55.059312 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-13b452b5-5b6e-4041-aa10-fcc7367d7e6f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:55.059801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-13b452b5-5b6e-4041-aa10-fcc7367d7e6f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:55.060259 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-13b452b5-5b6e-4041-aa10-fcc7367d7e6f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:55.060991 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-13b452b5-5b6e-4041-aa10-fcc7367d7e6f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:55.061448 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-13b452b5-5b6e-4041-aa10-fcc7367d7e6f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:55.061853 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-13b452b5-5b6e-4041-aa10-fcc7367d7e6f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:55.192525 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-13b452b5-5b6e-4041-aa10-fcc7367d7e6f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:18:55.200962 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-13b452b5-5b6e-4041-aa10-fcc7367d7e6f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1565 microversion: 2.1 time: 0.153360 Aug 28 10:18:55.201538 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 185/390] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:18:55 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:18:55.221258 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a6800fcf-01b1-41b4-bb9a-c78dc62bfaed tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:18:55.221769 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a6800fcf-01b1-41b4-bb9a-c78dc62bfaed tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:18:55.227723 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a6800fcf-01b1-41b4-bb9a-c78dc62bfaed tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:55.228187 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a6800fcf-01b1-41b4-bb9a-c78dc62bfaed tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:55.228638 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a6800fcf-01b1-41b4-bb9a-c78dc62bfaed tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:55.229308 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a6800fcf-01b1-41b4-bb9a-c78dc62bfaed tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:55.229750 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a6800fcf-01b1-41b4-bb9a-c78dc62bfaed tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:55.230142 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a6800fcf-01b1-41b4-bb9a-c78dc62bfaed tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:55.327663 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a6800fcf-01b1-41b4-bb9a-c78dc62bfaed tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109982 Aug 28 10:18:55.328460 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 206/391] 10.222.0.40 () {58 vars in 1275 bytes} [Sun Aug 28 10:18:55 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:18:56.256763 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-3f922d58-5fbd-4aff-92b5-98f15e2748a7 req-a580f15d-1439-4bd6-9cfa-56b58d32e7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c652c0fc-a515-4755-9eb4-8d46727fe990", "tag": "3db4dcbc-3ec6-4d01-8d04-71f8a8b8b4b0"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:18:56.266821 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-3f922d58-5fbd-4aff-92b5-98f15e2748a7 req-a580f15d-1439-4bd6-9cfa-56b58d32e7a1 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:18:56.267299 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-3f922d58-5fbd-4aff-92b5-98f15e2748a7 req-a580f15d-1439-4bd6-9cfa-56b58d32e7a1 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:18:56.267720 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-3f922d58-5fbd-4aff-92b5-98f15e2748a7 req-a580f15d-1439-4bd6-9cfa-56b58d32e7a1 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:18:56.279084 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-3f922d58-5fbd-4aff-92b5-98f15e2748a7 req-a580f15d-1439-4bd6-9cfa-56b58d32e7a1 service nova] Creating event network-changed:3db4dcbc-3ec6-4d01-8d04-71f8a8b8b4b0 for instance c652c0fc-a515-4755-9eb4-8d46727fe990 on hv-cinder-85200 Aug 28 10:18:56.284213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-3f922d58-5fbd-4aff-92b5-98f15e2748a7 req-a580f15d-1439-4bd6-9cfa-56b58d32e7a1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031220 Aug 28 10:18:56.284858 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 186/392] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:19:02.721666 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c2834df8-2328-4f85-8acc-14f2ed115da1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:02.722280 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c2834df8-2328-4f85-8acc-14f2ed115da1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:02.729804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c2834df8-2328-4f85-8acc-14f2ed115da1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:02.730363 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c2834df8-2328-4f85-8acc-14f2ed115da1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:02.730813 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c2834df8-2328-4f85-8acc-14f2ed115da1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:02.731572 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c2834df8-2328-4f85-8acc-14f2ed115da1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:02.732063 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c2834df8-2328-4f85-8acc-14f2ed115da1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:02.732546 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c2834df8-2328-4f85-8acc-14f2ed115da1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:02.757916 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c2834df8-2328-4f85-8acc-14f2ed115da1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193/ips" status: 200 len: 152 microversion: 2.20 time: 0.042853 Aug 28 10:19:02.758668 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 207/393] 10.222.0.40 () {60 vars in 1289 bytes} [Sun Aug 28 10:19:02 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 28 10:19:03.326107 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-9631fa00-d79a-4c53-a9b1-97e5a58b6823 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:03.326927 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-9631fa00-d79a-4c53-a9b1-97e5a58b6823 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:03.334209 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9631fa00-d79a-4c53-a9b1-97e5a58b6823 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:03.334680 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9631fa00-d79a-4c53-a9b1-97e5a58b6823 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:03.335101 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9631fa00-d79a-4c53-a9b1-97e5a58b6823 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:03.335771 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9631fa00-d79a-4c53-a9b1-97e5a58b6823 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:03.336206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9631fa00-d79a-4c53-a9b1-97e5a58b6823 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:03.336644 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9631fa00-d79a-4c53-a9b1-97e5a58b6823 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:03.359721 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-9631fa00-d79a-4c53-a9b1-97e5a58b6823 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4/ips" status: 200 len: 150 microversion: 2.1 time: 0.041141 Aug 28 10:19:03.360263 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 187/394] 10.222.0.40 () {58 vars in 1248 bytes} [Sun Aug 28 10:19:03 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:19:05.776338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5a3e8991-a047-4f2a-8695-55ae342f3238 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:19:05.777022 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5a3e8991-a047-4f2a-8695-55ae342f3238 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:05.783246 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5a3e8991-a047-4f2a-8695-55ae342f3238 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:05.783726 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5a3e8991-a047-4f2a-8695-55ae342f3238 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:05.784147 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5a3e8991-a047-4f2a-8695-55ae342f3238 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:05.784859 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5a3e8991-a047-4f2a-8695-55ae342f3238 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:05.785308 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5a3e8991-a047-4f2a-8695-55ae342f3238 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:05.785809 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5a3e8991-a047-4f2a-8695-55ae342f3238 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:05.788226 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=67 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:05.805403 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-d9c22b92-50d2-4658-b5c8-fb5ff2c9b00d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6728751-c833-45bd-b37c-2cef24a537d2"}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:19:05.807691 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-d9c22b92-50d2-4658-b5c8-fb5ff2c9b00d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:05.810015 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-5a3e8991-a047-4f2a-8695-55ae342f3238 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lazy-loading 'flavor' on Instance uuid 2a0819fc-2347-457b-804f-7ef819596193 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:19:05.814282 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d9c22b92-50d2-4658-b5c8-fb5ff2c9b00d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:05.814756 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d9c22b92-50d2-4658-b5c8-fb5ff2c9b00d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:05.815161 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d9c22b92-50d2-4658-b5c8-fb5ff2c9b00d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:05.815835 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d9c22b92-50d2-4658-b5c8-fb5ff2c9b00d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:05.816276 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d9c22b92-50d2-4658-b5c8-fb5ff2c9b00d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:05.816716 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d9c22b92-50d2-4658-b5c8-fb5ff2c9b00d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:05.819193 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=83 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:06.060189 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5a3e8991-a047-4f2a-8695-55ae342f3238 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "POST /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193/action" status: 202 len: 0 microversion: 2.20 time: 0.287527 Aug 28 10:19:06.061014 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 208/395] 10.222.0.40 () {62 vars in 1319 bytes} [Sun Aug 28 10:19:05 2022] POST /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 28 10:19:06.069985 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d39600c6-b60f-437c-a5d2-9675a14958c7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:06.070912 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d39600c6-b60f-437c-a5d2-9675a14958c7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:06.077063 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d39600c6-b60f-437c-a5d2-9675a14958c7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:06.077671 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d39600c6-b60f-437c-a5d2-9675a14958c7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:06.077939 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d39600c6-b60f-437c-a5d2-9675a14958c7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:06.078867 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d39600c6-b60f-437c-a5d2-9675a14958c7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:06.079365 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d39600c6-b60f-437c-a5d2-9675a14958c7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:06.079773 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d39600c6-b60f-437c-a5d2-9675a14958c7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:06.149119 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-d9c22b92-50d2-4658-b5c8-fb5ff2c9b00d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "POST /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347768 Aug 28 10:19:06.149728 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 188/396] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Aug 28 10:19:05 2022] POST /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4/os-volume_attachments => generated 194 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:19:06.212392 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d39600c6-b60f-437c-a5d2-9675a14958c7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:06.221530 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d39600c6-b60f-437c-a5d2-9675a14958c7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:06.222948 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d39600c6-b60f-437c-a5d2-9675a14958c7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:06.224087 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d39600c6-b60f-437c-a5d2-9675a14958c7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.158510 Aug 28 10:19:06.224678 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 209/397] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:06 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 28 10:19:06.613261 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-90776eb7-f79b-48ec-8068-1d216aa34e43 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b1b1ab7-26df-4c47-837d-30ddda85f5bc", "device": "/dev/sdb"}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:19:06.616367 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-90776eb7-f79b-48ec-8068-1d216aa34e43 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 78c1fa2f-a973-4e1d-834a-c037b6272109] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:06.623371 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-90776eb7-f79b-48ec-8068-1d216aa34e43 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:06.623924 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-90776eb7-f79b-48ec-8068-1d216aa34e43 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:06.624354 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-90776eb7-f79b-48ec-8068-1d216aa34e43 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:06.625149 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-90776eb7-f79b-48ec-8068-1d216aa34e43 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:06.625596 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-90776eb7-f79b-48ec-8068-1d216aa34e43 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:06.626010 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-90776eb7-f79b-48ec-8068-1d216aa34e43 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:06.943925 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-90776eb7-f79b-48ec-8068-1d216aa34e43 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "POST /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334824 Aug 28 10:19:06.948774 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 189/398] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Aug 28 10:19:06 2022] POST /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:19:07.248348 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5b5e14d8-a0fb-46a0-9260-c35bf0d1ad8f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:07.249010 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5b5e14d8-a0fb-46a0-9260-c35bf0d1ad8f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:07.256887 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5b5e14d8-a0fb-46a0-9260-c35bf0d1ad8f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:07.257361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5b5e14d8-a0fb-46a0-9260-c35bf0d1ad8f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:07.257772 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5b5e14d8-a0fb-46a0-9260-c35bf0d1ad8f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:07.258445 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5b5e14d8-a0fb-46a0-9260-c35bf0d1ad8f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:07.259042 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5b5e14d8-a0fb-46a0-9260-c35bf0d1ad8f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:07.259452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5b5e14d8-a0fb-46a0-9260-c35bf0d1ad8f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:07.389228 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5b5e14d8-a0fb-46a0-9260-c35bf0d1ad8f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:07.397568 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5b5e14d8-a0fb-46a0-9260-c35bf0d1ad8f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:07.398982 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5b5e14d8-a0fb-46a0-9260-c35bf0d1ad8f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:07.400144 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5b5e14d8-a0fb-46a0-9260-c35bf0d1ad8f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.156343 Aug 28 10:19:07.400831 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 210/399] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:07 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:08.430460 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c170ebcd-992f-4e42-a5b2-13871d9bef75 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:08.431490 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c170ebcd-992f-4e42-a5b2-13871d9bef75 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:08.441196 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c170ebcd-992f-4e42-a5b2-13871d9bef75 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:08.441912 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c170ebcd-992f-4e42-a5b2-13871d9bef75 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:08.442552 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c170ebcd-992f-4e42-a5b2-13871d9bef75 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:08.443586 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c170ebcd-992f-4e42-a5b2-13871d9bef75 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:08.444262 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c170ebcd-992f-4e42-a5b2-13871d9bef75 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:08.444937 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c170ebcd-992f-4e42-a5b2-13871d9bef75 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:08.582556 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c170ebcd-992f-4e42-a5b2-13871d9bef75 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:08.591672 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c170ebcd-992f-4e42-a5b2-13871d9bef75 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:08.593125 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c170ebcd-992f-4e42-a5b2-13871d9bef75 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:08.594276 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c170ebcd-992f-4e42-a5b2-13871d9bef75 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.170699 Aug 28 10:19:08.594813 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 190/400] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:08 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:09.616424 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4c3890a0-a8a7-4560-a370-53afaa5efc2c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:09.617045 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4c3890a0-a8a7-4560-a370-53afaa5efc2c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:09.623496 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4c3890a0-a8a7-4560-a370-53afaa5efc2c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:09.623969 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4c3890a0-a8a7-4560-a370-53afaa5efc2c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:09.624389 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4c3890a0-a8a7-4560-a370-53afaa5efc2c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:09.625099 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4c3890a0-a8a7-4560-a370-53afaa5efc2c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:09.625560 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4c3890a0-a8a7-4560-a370-53afaa5efc2c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:09.625967 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4c3890a0-a8a7-4560-a370-53afaa5efc2c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:09.770184 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4c3890a0-a8a7-4560-a370-53afaa5efc2c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:09.778660 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4c3890a0-a8a7-4560-a370-53afaa5efc2c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:09.780076 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4c3890a0-a8a7-4560-a370-53afaa5efc2c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:09.781272 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4c3890a0-a8a7-4560-a370-53afaa5efc2c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.168778 Aug 28 10:19:09.781839 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 211/401] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:09 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:10.809323 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-9f8806bd-886c-49ec-9cb2-811b8845cdf5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:10.810188 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-9f8806bd-886c-49ec-9cb2-811b8845cdf5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:10.821231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9f8806bd-886c-49ec-9cb2-811b8845cdf5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:10.822030 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9f8806bd-886c-49ec-9cb2-811b8845cdf5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:10.822748 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9f8806bd-886c-49ec-9cb2-811b8845cdf5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:10.823875 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9f8806bd-886c-49ec-9cb2-811b8845cdf5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:10.824665 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9f8806bd-886c-49ec-9cb2-811b8845cdf5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:10.825370 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9f8806bd-886c-49ec-9cb2-811b8845cdf5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:10.958462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-9f8806bd-886c-49ec-9cb2-811b8845cdf5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:10.967240 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-9f8806bd-886c-49ec-9cb2-811b8845cdf5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:10.968705 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-9f8806bd-886c-49ec-9cb2-811b8845cdf5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:10.969856 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-9f8806bd-886c-49ec-9cb2-811b8845cdf5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.167698 Aug 28 10:19:10.970416 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 191/402] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:10 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:11.997311 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3b7b75fe-fb84-47b7-a7fb-b48bdf5506c1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:11.998284 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3b7b75fe-fb84-47b7-a7fb-b48bdf5506c1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:12.006806 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b7b75fe-fb84-47b7-a7fb-b48bdf5506c1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:12.007282 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b7b75fe-fb84-47b7-a7fb-b48bdf5506c1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:12.007699 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b7b75fe-fb84-47b7-a7fb-b48bdf5506c1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:12.008380 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b7b75fe-fb84-47b7-a7fb-b48bdf5506c1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:12.008885 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b7b75fe-fb84-47b7-a7fb-b48bdf5506c1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:12.009324 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b7b75fe-fb84-47b7-a7fb-b48bdf5506c1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:12.142979 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3b7b75fe-fb84-47b7-a7fb-b48bdf5506c1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:12.151466 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3b7b75fe-fb84-47b7-a7fb-b48bdf5506c1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:12.152926 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3b7b75fe-fb84-47b7-a7fb-b48bdf5506c1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:12.154080 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3b7b75fe-fb84-47b7-a7fb-b48bdf5506c1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.163533 Aug 28 10:19:12.154621 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 212/403] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:11 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:13.185131 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-061f977e-d3ed-4369-a1a5-fb9bc0273f39 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:13.185761 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-061f977e-d3ed-4369-a1a5-fb9bc0273f39 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:13.188664 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=30 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:13.194153 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-061f977e-d3ed-4369-a1a5-fb9bc0273f39 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:13.194626 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-061f977e-d3ed-4369-a1a5-fb9bc0273f39 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:13.195051 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-061f977e-d3ed-4369-a1a5-fb9bc0273f39 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:13.195736 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-061f977e-d3ed-4369-a1a5-fb9bc0273f39 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:13.196198 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-061f977e-d3ed-4369-a1a5-fb9bc0273f39 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:13.196650 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-061f977e-d3ed-4369-a1a5-fb9bc0273f39 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:13.333228 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-061f977e-d3ed-4369-a1a5-fb9bc0273f39 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:13.346009 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-061f977e-d3ed-4369-a1a5-fb9bc0273f39 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:13.348211 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-061f977e-d3ed-4369-a1a5-fb9bc0273f39 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:13.349778 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-061f977e-d3ed-4369-a1a5-fb9bc0273f39 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.168686 Aug 28 10:19:13.350367 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 192/404] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:13 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:14.373256 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-da28df82-a3f8-4881-8571-70f2c9ffab98 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:14.375380 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-da28df82-a3f8-4881-8571-70f2c9ffab98 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:14.380169 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da28df82-a3f8-4881-8571-70f2c9ffab98 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:14.380734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da28df82-a3f8-4881-8571-70f2c9ffab98 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:14.381154 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da28df82-a3f8-4881-8571-70f2c9ffab98 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:14.381910 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da28df82-a3f8-4881-8571-70f2c9ffab98 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:14.382427 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da28df82-a3f8-4881-8571-70f2c9ffab98 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:14.382835 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da28df82-a3f8-4881-8571-70f2c9ffab98 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:14.512871 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-da28df82-a3f8-4881-8571-70f2c9ffab98 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:14.521189 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-da28df82-a3f8-4881-8571-70f2c9ffab98 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:14.522726 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-da28df82-a3f8-4881-8571-70f2c9ffab98 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:14.523864 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-da28df82-a3f8-4881-8571-70f2c9ffab98 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.154733 Aug 28 10:19:14.524448 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 213/405] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:14 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:14.804780 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-38635c4c-1284-490b-bb88-7280bd126424 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Action: 'create', calling method: .version_select at 0x7f7a1c2f68b0>, body: {"keypair": {"name": "tempest-keypair-173794329", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzg4waIIe/hfuB6PTUkQMkS55DrQuxk5TeUeu3CluRdaZRLQq+CiQFamdXe0/2LLuAjm0qP7BIAyhW5eCQjjG+bc9T/9++UKFIJWwlFSUfwb2WKB3nmtOil4ZY8JbWhUQ=="}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:19:14.822726 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-38635c4c-1284-490b-bb88-7280bd126424 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Getting quotas for project eefcb341ab8d4823a95c5bce47395083. Resources: {'key_pairs'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:19:14.826840 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-38635c4c-1284-490b-bb88-7280bd126424 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Getting quotas for user ed4711b7691643109007e173fee1c405 and project eefcb341ab8d4823a95c5bce47395083. Resources: {'key_pairs'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:19:14.851584 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-38635c4c-1284-490b-bb88-7280bd126424 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050735 Aug 28 10:19:14.852179 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 193/406] 10.222.0.40 () {60 vars in 1159 bytes} [Sun Aug 28 10:19:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:19:15.555246 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b8369207-8c60-474d-a3fd-b825e6c23991 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:15.555855 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b8369207-8c60-474d-a3fd-b825e6c23991 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:15.562000 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b8369207-8c60-474d-a3fd-b825e6c23991 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:15.562546 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b8369207-8c60-474d-a3fd-b825e6c23991 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:15.563068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b8369207-8c60-474d-a3fd-b825e6c23991 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:15.563819 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b8369207-8c60-474d-a3fd-b825e6c23991 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:15.564264 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b8369207-8c60-474d-a3fd-b825e6c23991 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:15.564711 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b8369207-8c60-474d-a3fd-b825e6c23991 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:15.791690 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b8369207-8c60-474d-a3fd-b825e6c23991 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:15.800058 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b8369207-8c60-474d-a3fd-b825e6c23991 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:15.801795 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b8369207-8c60-474d-a3fd-b825e6c23991 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:15.802920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b8369207-8c60-474d-a3fd-b825e6c23991 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.251601 Aug 28 10:19:15.803625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 214/407] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:15 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:16.252363 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-ca6c2260-3415-47bb-bf04-c451e18ed1fd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1783764848", "imageRef": "2780c39b-8bd3-4e73-9669-2b2e29474f3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68250cdd-7701-4086-beb4-5863d8d92f6a"}], "security_groups": [{"name": "tempest-securitygroup--467098009"}], "key_name": "tempest-keypair-173794329", "user_data": "}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:19:16.357488 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.network.neutron [None req-ca6c2260-3415-47bb-bf04-c451e18ed1fd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] validate_networks() for [('68250cdd-7701-4086-beb4-5863d8d92f6a', None, None, None, None, None)] {{(pid=120664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 28 10:19:16.737167 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-ca6c2260-3415-47bb-bf04-c451e18ed1fd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Flavor limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 28 10:19:16.737592 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-ca6c2260-3415-47bb-bf04-c451e18ed1fd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Image limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 28 10:19:16.738059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-ca6c2260-3415-47bb-bf04-c451e18ed1fd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Flavor pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 28 10:19:16.738482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-ca6c2260-3415-47bb-bf04-c451e18ed1fd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Image pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 28 10:19:16.738892 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-ca6c2260-3415-47bb-bf04-c451e18ed1fd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 28 10:19:16.748244 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ca6c2260-3415-47bb-bf04-c451e18ed1fd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:16.748774 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ca6c2260-3415-47bb-bf04-c451e18ed1fd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:16.749206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ca6c2260-3415-47bb-bf04-c451e18ed1fd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:16.749925 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ca6c2260-3415-47bb-bf04-c451e18ed1fd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:16.750370 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ca6c2260-3415-47bb-bf04-c451e18ed1fd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:16.750795 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ca6c2260-3415-47bb-bf04-c451e18ed1fd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:16.768120 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-ca6c2260-3415-47bb-bf04-c451e18ed1fd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Getting quotas for project eefcb341ab8d4823a95c5bce47395083. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:19:16.772471 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-ca6c2260-3415-47bb-bf04-c451e18ed1fd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Getting quotas for user ed4711b7691643109007e173fee1c405 and project eefcb341ab8d4823a95c5bce47395083. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:19:16.783823 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-ca6c2260-3415-47bb-bf04-c451e18ed1fd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Going to run 1 instances... {{(pid=120664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 28 10:19:16.786145 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-ca6c2260-3415-47bb-bf04-c451e18ed1fd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2780c39b-8bd3-4e73-9669-2b2e29474f3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 28 10:19:16.826430 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b5690a64-24af-44c9-b8a7-412751a0a74f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:16.827091 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b5690a64-24af-44c9-b8a7-412751a0a74f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:16.833396 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5690a64-24af-44c9-b8a7-412751a0a74f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:16.833874 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5690a64-24af-44c9-b8a7-412751a0a74f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:16.834295 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5690a64-24af-44c9-b8a7-412751a0a74f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:16.836096 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5690a64-24af-44c9-b8a7-412751a0a74f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:16.836547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5690a64-24af-44c9-b8a7-412751a0a74f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:16.836945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-ca6c2260-3415-47bb-bf04-c451e18ed1fd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.589092 Aug 28 10:19:16.837110 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5690a64-24af-44c9-b8a7-412751a0a74f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:16.837845 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 194/408] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Aug 28 10:19:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 28 10:19:16.847980 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-920146e1-f9ba-4d52-9eba-f813f039c751 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:16.848829 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-920146e1-f9ba-4d52-9eba-f813f039c751 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:16.931957 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-920146e1-f9ba-4d52-9eba-f813f039c751 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:16.939468 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-920146e1-f9ba-4d52-9eba-f813f039c751 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1241 microversion: 2.1 time: 0.094937 Aug 28 10:19:16.940607 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 195/409] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:16 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:17.009140 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b5690a64-24af-44c9-b8a7-412751a0a74f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:17.017216 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b5690a64-24af-44c9-b8a7-412751a0a74f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:17.018636 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b5690a64-24af-44c9-b8a7-412751a0a74f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:17.019773 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b5690a64-24af-44c9-b8a7-412751a0a74f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.197629 Aug 28 10:19:17.020331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 215/410] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:16 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 28 10:19:17.959989 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-5e914927-0002-4fbe-a48f-53d41c6a409e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:17.960624 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-5e914927-0002-4fbe-a48f-53d41c6a409e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:17.967352 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5e914927-0002-4fbe-a48f-53d41c6a409e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:17.967826 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5e914927-0002-4fbe-a48f-53d41c6a409e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:17.968312 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5e914927-0002-4fbe-a48f-53d41c6a409e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:17.969040 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5e914927-0002-4fbe-a48f-53d41c6a409e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:17.969476 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5e914927-0002-4fbe-a48f-53d41c6a409e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:17.969890 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5e914927-0002-4fbe-a48f-53d41c6a409e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:18.032974 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-5e914927-0002-4fbe-a48f-53d41c6a409e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:18.041015 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-5e914927-0002-4fbe-a48f-53d41c6a409e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1293 microversion: 2.1 time: 0.084984 Aug 28 10:19:18.041539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 196/411] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:17 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:18.043667 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7a8bd116-6dac-44a4-8ffc-2d928251fd8e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:18.044267 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7a8bd116-6dac-44a4-8ffc-2d928251fd8e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:18.046283 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=28 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:18.051629 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a8bd116-6dac-44a4-8ffc-2d928251fd8e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:18.052105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a8bd116-6dac-44a4-8ffc-2d928251fd8e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:18.052545 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a8bd116-6dac-44a4-8ffc-2d928251fd8e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:18.053292 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a8bd116-6dac-44a4-8ffc-2d928251fd8e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:18.053731 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a8bd116-6dac-44a4-8ffc-2d928251fd8e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:18.054143 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a8bd116-6dac-44a4-8ffc-2d928251fd8e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:18.184618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7a8bd116-6dac-44a4-8ffc-2d928251fd8e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:18.193464 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7a8bd116-6dac-44a4-8ffc-2d928251fd8e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:18.194919 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7a8bd116-6dac-44a4-8ffc-2d928251fd8e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:18.196070 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7a8bd116-6dac-44a4-8ffc-2d928251fd8e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.156670 Aug 28 10:19:18.196675 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 216/412] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:18 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:19.062000 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-150d65b9-47bd-476a-a315-e34f550ef4fb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:19.062592 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-150d65b9-47bd-476a-a315-e34f550ef4fb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:19.069550 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-150d65b9-47bd-476a-a315-e34f550ef4fb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:19.070030 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-150d65b9-47bd-476a-a315-e34f550ef4fb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:19.070519 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-150d65b9-47bd-476a-a315-e34f550ef4fb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:19.071209 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-150d65b9-47bd-476a-a315-e34f550ef4fb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:19.071660 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-150d65b9-47bd-476a-a315-e34f550ef4fb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:19.072082 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-150d65b9-47bd-476a-a315-e34f550ef4fb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:19.138867 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-150d65b9-47bd-476a-a315-e34f550ef4fb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:19.147127 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-150d65b9-47bd-476a-a315-e34f550ef4fb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1299 microversion: 2.1 time: 0.089059 Aug 28 10:19:19.147728 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 197/413] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:19 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:19.219313 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c0ec8a95-ccdc-4184-88ee-c5eea118b79c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:19.219912 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c0ec8a95-ccdc-4184-88ee-c5eea118b79c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:19.226165 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0ec8a95-ccdc-4184-88ee-c5eea118b79c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:19.226770 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0ec8a95-ccdc-4184-88ee-c5eea118b79c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:19.227197 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0ec8a95-ccdc-4184-88ee-c5eea118b79c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:19.227958 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0ec8a95-ccdc-4184-88ee-c5eea118b79c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:19.228695 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0ec8a95-ccdc-4184-88ee-c5eea118b79c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:19.229141 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0ec8a95-ccdc-4184-88ee-c5eea118b79c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:19.362860 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c0ec8a95-ccdc-4184-88ee-c5eea118b79c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:19.371158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c0ec8a95-ccdc-4184-88ee-c5eea118b79c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:19.372615 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c0ec8a95-ccdc-4184-88ee-c5eea118b79c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:19.373766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c0ec8a95-ccdc-4184-88ee-c5eea118b79c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.158532 Aug 28 10:19:19.374331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 217/414] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:19 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:20.168030 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-9db64803-d560-4194-bf6c-e5fe8ac7c3c0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:20.169349 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-9db64803-d560-4194-bf6c-e5fe8ac7c3c0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:20.175849 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9db64803-d560-4194-bf6c-e5fe8ac7c3c0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:20.176576 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9db64803-d560-4194-bf6c-e5fe8ac7c3c0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:20.177174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9db64803-d560-4194-bf6c-e5fe8ac7c3c0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:20.178036 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9db64803-d560-4194-bf6c-e5fe8ac7c3c0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:20.178650 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9db64803-d560-4194-bf6c-e5fe8ac7c3c0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:20.179264 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9db64803-d560-4194-bf6c-e5fe8ac7c3c0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:20.313399 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-9db64803-d560-4194-bf6c-e5fe8ac7c3c0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:20.321764 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-9db64803-d560-4194-bf6c-e5fe8ac7c3c0 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1366 microversion: 2.1 time: 0.158059 Aug 28 10:19:20.322368 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 198/415] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:20 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:19:20.397918 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6fea9a14-34ad-499a-ad51-d6b2d3344fde tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:20.398608 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6fea9a14-34ad-499a-ad51-d6b2d3344fde tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:20.407520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fea9a14-34ad-499a-ad51-d6b2d3344fde tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:20.408121 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fea9a14-34ad-499a-ad51-d6b2d3344fde tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:20.408667 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fea9a14-34ad-499a-ad51-d6b2d3344fde tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:20.409449 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fea9a14-34ad-499a-ad51-d6b2d3344fde tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:20.409963 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fea9a14-34ad-499a-ad51-d6b2d3344fde tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:20.410450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fea9a14-34ad-499a-ad51-d6b2d3344fde tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:20.773588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6fea9a14-34ad-499a-ad51-d6b2d3344fde tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:20.783660 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6fea9a14-34ad-499a-ad51-d6b2d3344fde tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:20.786035 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6fea9a14-34ad-499a-ad51-d6b2d3344fde tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:20.787592 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6fea9a14-34ad-499a-ad51-d6b2d3344fde tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.394097 Aug 28 10:19:20.789280 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 218/416] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:20 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:20.924895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-9434765b-74a5-4653-94bd-eca133946991 req-cca3608c-11ec-4be9-91d1-906f802f66c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "109322c8-1668-4c81-bac7-b05bfacf1709", "tag": "beb69a75-9bbc-4b73-b637-809ea041054b"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:19:20.935157 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-9434765b-74a5-4653-94bd-eca133946991 req-cca3608c-11ec-4be9-91d1-906f802f66c5 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:20.935780 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-9434765b-74a5-4653-94bd-eca133946991 req-cca3608c-11ec-4be9-91d1-906f802f66c5 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:20.936643 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-9434765b-74a5-4653-94bd-eca133946991 req-cca3608c-11ec-4be9-91d1-906f802f66c5 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:20.950442 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-9434765b-74a5-4653-94bd-eca133946991 req-cca3608c-11ec-4be9-91d1-906f802f66c5 service nova] Creating event network-changed:beb69a75-9bbc-4b73-b637-809ea041054b for instance 109322c8-1668-4c81-bac7-b05bfacf1709 on hv-cinder-85200 Aug 28 10:19:20.955572 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-9434765b-74a5-4653-94bd-eca133946991 req-cca3608c-11ec-4be9-91d1-906f802f66c5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034582 Aug 28 10:19:20.956736 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 199/417] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:19:21.342585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-46fcc6b6-83ae-4500-8b5d-79885203c89e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:21.343201 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-46fcc6b6-83ae-4500-8b5d-79885203c89e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:21.349731 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46fcc6b6-83ae-4500-8b5d-79885203c89e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:21.350190 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46fcc6b6-83ae-4500-8b5d-79885203c89e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:21.350617 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46fcc6b6-83ae-4500-8b5d-79885203c89e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:21.351301 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46fcc6b6-83ae-4500-8b5d-79885203c89e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:21.351788 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46fcc6b6-83ae-4500-8b5d-79885203c89e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:21.352207 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46fcc6b6-83ae-4500-8b5d-79885203c89e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:21.480822 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-46fcc6b6-83ae-4500-8b5d-79885203c89e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:21.488533 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-46fcc6b6-83ae-4500-8b5d-79885203c89e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1366 microversion: 2.1 time: 0.149889 Aug 28 10:19:21.489117 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 219/418] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:21 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:21.817862 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-25299de1-85eb-46c1-9c20-721c254f4f27 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:21.818871 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-25299de1-85eb-46c1-9c20-721c254f4f27 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:21.829670 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-25299de1-85eb-46c1-9c20-721c254f4f27 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:21.830464 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-25299de1-85eb-46c1-9c20-721c254f4f27 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:21.831172 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-25299de1-85eb-46c1-9c20-721c254f4f27 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:21.832288 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-25299de1-85eb-46c1-9c20-721c254f4f27 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:21.833080 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-25299de1-85eb-46c1-9c20-721c254f4f27 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:21.833781 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-25299de1-85eb-46c1-9c20-721c254f4f27 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:21.967298 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-25299de1-85eb-46c1-9c20-721c254f4f27 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:21.975461 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-25299de1-85eb-46c1-9c20-721c254f4f27 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:21.976934 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-25299de1-85eb-46c1-9c20-721c254f4f27 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:21.978079 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-25299de1-85eb-46c1-9c20-721c254f4f27 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.168954 Aug 28 10:19:21.978642 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 200/419] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:21 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:22.513482 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-30ba2a29-129f-46d8-812c-ab7d1ed383e9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:22.514460 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-30ba2a29-129f-46d8-812c-ab7d1ed383e9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:22.524745 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30ba2a29-129f-46d8-812c-ab7d1ed383e9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:22.525420 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30ba2a29-129f-46d8-812c-ab7d1ed383e9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:22.525855 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30ba2a29-129f-46d8-812c-ab7d1ed383e9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:22.526526 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30ba2a29-129f-46d8-812c-ab7d1ed383e9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:22.526974 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30ba2a29-129f-46d8-812c-ab7d1ed383e9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:22.527388 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30ba2a29-129f-46d8-812c-ab7d1ed383e9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:22.660983 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-30ba2a29-129f-46d8-812c-ab7d1ed383e9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:22.669536 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-30ba2a29-129f-46d8-812c-ab7d1ed383e9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1366 microversion: 2.1 time: 0.162789 Aug 28 10:19:22.670102 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 220/420] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:22 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:23.012135 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-101fc8b9-70c3-439a-b52d-b5075b45732c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:23.013113 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-101fc8b9-70c3-439a-b52d-b5075b45732c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:23.024081 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-101fc8b9-70c3-439a-b52d-b5075b45732c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:23.024942 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-101fc8b9-70c3-439a-b52d-b5075b45732c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:23.025661 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-101fc8b9-70c3-439a-b52d-b5075b45732c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:23.026786 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-101fc8b9-70c3-439a-b52d-b5075b45732c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:23.027534 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-101fc8b9-70c3-439a-b52d-b5075b45732c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:23.028233 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-101fc8b9-70c3-439a-b52d-b5075b45732c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:23.164243 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-101fc8b9-70c3-439a-b52d-b5075b45732c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:23.173453 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-101fc8b9-70c3-439a-b52d-b5075b45732c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:23.174915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-101fc8b9-70c3-439a-b52d-b5075b45732c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:23.176077 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-101fc8b9-70c3-439a-b52d-b5075b45732c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.170559 Aug 28 10:19:23.176691 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 201/421] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:23 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:23.691553 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f82f4677-5ea6-4847-ae51-18dfd4900d5e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:23.692216 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f82f4677-5ea6-4847-ae51-18dfd4900d5e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:23.699407 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f82f4677-5ea6-4847-ae51-18dfd4900d5e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:23.699886 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f82f4677-5ea6-4847-ae51-18dfd4900d5e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:23.700297 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f82f4677-5ea6-4847-ae51-18dfd4900d5e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:23.701008 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f82f4677-5ea6-4847-ae51-18dfd4900d5e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:23.701447 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f82f4677-5ea6-4847-ae51-18dfd4900d5e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:23.701854 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f82f4677-5ea6-4847-ae51-18dfd4900d5e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:23.839830 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f82f4677-5ea6-4847-ae51-18dfd4900d5e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:23.847834 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f82f4677-5ea6-4847-ae51-18dfd4900d5e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1366 microversion: 2.1 time: 0.160831 Aug 28 10:19:23.848336 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 221/422] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:23 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:24.202600 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-216ca255-39c8-49c8-8255-474fdd4191fb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:24.203547 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-216ca255-39c8-49c8-8255-474fdd4191fb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:24.213825 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-216ca255-39c8-49c8-8255-474fdd4191fb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:24.214308 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-216ca255-39c8-49c8-8255-474fdd4191fb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:24.214704 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-216ca255-39c8-49c8-8255-474fdd4191fb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:24.215420 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-216ca255-39c8-49c8-8255-474fdd4191fb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:24.215867 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-216ca255-39c8-49c8-8255-474fdd4191fb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:24.216284 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-216ca255-39c8-49c8-8255-474fdd4191fb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:24.342079 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-216ca255-39c8-49c8-8255-474fdd4191fb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:24.350285 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-216ca255-39c8-49c8-8255-474fdd4191fb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:24.351709 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-216ca255-39c8-49c8-8255-474fdd4191fb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:24.352954 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-216ca255-39c8-49c8-8255-474fdd4191fb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.156716 Aug 28 10:19:24.353478 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 202/423] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:24 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:24.867969 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-00edb6cf-52b6-46ec-804d-fb87856527cd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:24.868587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-00edb6cf-52b6-46ec-804d-fb87856527cd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:24.874799 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-00edb6cf-52b6-46ec-804d-fb87856527cd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:24.875264 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-00edb6cf-52b6-46ec-804d-fb87856527cd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:24.875682 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-00edb6cf-52b6-46ec-804d-fb87856527cd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:24.876338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-00edb6cf-52b6-46ec-804d-fb87856527cd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:24.876911 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-00edb6cf-52b6-46ec-804d-fb87856527cd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:24.877317 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-00edb6cf-52b6-46ec-804d-fb87856527cd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:25.021576 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-00edb6cf-52b6-46ec-804d-fb87856527cd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:25.023743 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:25.031260 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-00edb6cf-52b6-46ec-804d-fb87856527cd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1366 microversion: 2.1 time: 0.167229 Aug 28 10:19:25.031832 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 222/424] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:24 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:25.379937 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f5b1c18e-b29f-49c4-8b76-ea8a09ae9829 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:25.381412 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f5b1c18e-b29f-49c4-8b76-ea8a09ae9829 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:25.394203 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f5b1c18e-b29f-49c4-8b76-ea8a09ae9829 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:25.394994 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f5b1c18e-b29f-49c4-8b76-ea8a09ae9829 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:25.395708 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f5b1c18e-b29f-49c4-8b76-ea8a09ae9829 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:25.396903 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f5b1c18e-b29f-49c4-8b76-ea8a09ae9829 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:25.397730 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f5b1c18e-b29f-49c4-8b76-ea8a09ae9829 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:25.398428 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f5b1c18e-b29f-49c4-8b76-ea8a09ae9829 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:25.531181 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f5b1c18e-b29f-49c4-8b76-ea8a09ae9829 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:25.539335 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f5b1c18e-b29f-49c4-8b76-ea8a09ae9829 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:25.541215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f5b1c18e-b29f-49c4-8b76-ea8a09ae9829 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:25.542377 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f5b1c18e-b29f-49c4-8b76-ea8a09ae9829 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.169034 Aug 28 10:19:25.542935 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 203/425] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:25 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:26.056844 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2928edb9-1103-4f52-99b7-f1abdc3881cb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:26.057841 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2928edb9-1103-4f52-99b7-f1abdc3881cb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:26.068957 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2928edb9-1103-4f52-99b7-f1abdc3881cb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:26.069742 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2928edb9-1103-4f52-99b7-f1abdc3881cb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:26.070450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2928edb9-1103-4f52-99b7-f1abdc3881cb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:26.071565 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2928edb9-1103-4f52-99b7-f1abdc3881cb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:26.072221 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2928edb9-1103-4f52-99b7-f1abdc3881cb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:26.072659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2928edb9-1103-4f52-99b7-f1abdc3881cb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:26.203124 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2928edb9-1103-4f52-99b7-f1abdc3881cb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:26.211220 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2928edb9-1103-4f52-99b7-f1abdc3881cb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1366 microversion: 2.1 time: 0.161441 Aug 28 10:19:26.211788 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 223/426] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:26 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:26.568953 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-7c991c82-efc3-412b-8b18-ac35d01a4849 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:26.569933 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-7c991c82-efc3-412b-8b18-ac35d01a4849 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:26.578141 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7c991c82-efc3-412b-8b18-ac35d01a4849 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:26.578651 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7c991c82-efc3-412b-8b18-ac35d01a4849 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:26.579081 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7c991c82-efc3-412b-8b18-ac35d01a4849 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:26.579773 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7c991c82-efc3-412b-8b18-ac35d01a4849 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:26.580216 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7c991c82-efc3-412b-8b18-ac35d01a4849 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:26.580664 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7c991c82-efc3-412b-8b18-ac35d01a4849 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:26.726041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7c991c82-efc3-412b-8b18-ac35d01a4849 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:26.734914 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7c991c82-efc3-412b-8b18-ac35d01a4849 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:26.736341 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7c991c82-efc3-412b-8b18-ac35d01a4849 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:26.737524 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-7c991c82-efc3-412b-8b18-ac35d01a4849 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.175138 Aug 28 10:19:26.738087 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 204/427] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:26 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:27.231984 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-301691d0-7b95-432e-8789-eef3233e9330 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:27.232497 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-301691d0-7b95-432e-8789-eef3233e9330 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:27.238877 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-301691d0-7b95-432e-8789-eef3233e9330 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:27.239353 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-301691d0-7b95-432e-8789-eef3233e9330 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:27.239771 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-301691d0-7b95-432e-8789-eef3233e9330 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:27.240438 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-301691d0-7b95-432e-8789-eef3233e9330 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:27.240910 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-301691d0-7b95-432e-8789-eef3233e9330 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:27.241320 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-301691d0-7b95-432e-8789-eef3233e9330 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:27.385125 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-301691d0-7b95-432e-8789-eef3233e9330 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:27.392808 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-301691d0-7b95-432e-8789-eef3233e9330 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1366 microversion: 2.1 time: 0.164800 Aug 28 10:19:27.393383 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 224/428] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:27 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:27.764962 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-d6b234b8-2da9-4a76-b978-8e72ba6a4def tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:27.765802 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-d6b234b8-2da9-4a76-b978-8e72ba6a4def tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:27.768896 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=2 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:27.770015 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=12 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:27.777903 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d6b234b8-2da9-4a76-b978-8e72ba6a4def tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:27.778381 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d6b234b8-2da9-4a76-b978-8e72ba6a4def tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:27.778810 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d6b234b8-2da9-4a76-b978-8e72ba6a4def tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:27.779480 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d6b234b8-2da9-4a76-b978-8e72ba6a4def tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:27.779931 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d6b234b8-2da9-4a76-b978-8e72ba6a4def tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:27.780345 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d6b234b8-2da9-4a76-b978-8e72ba6a4def tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:27.796164 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:27.914355 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d6b234b8-2da9-4a76-b978-8e72ba6a4def tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:27.922877 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d6b234b8-2da9-4a76-b978-8e72ba6a4def tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:27.924294 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d6b234b8-2da9-4a76-b978-8e72ba6a4def tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:27.925465 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-d6b234b8-2da9-4a76-b978-8e72ba6a4def tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.167289 Aug 28 10:19:27.926020 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 205/429] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:27 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:28.418033 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-41f86fdb-3280-4acd-bef0-91d33f01a111 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:28.418854 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-41f86fdb-3280-4acd-bef0-91d33f01a111 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:28.429190 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41f86fdb-3280-4acd-bef0-91d33f01a111 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:28.430001 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41f86fdb-3280-4acd-bef0-91d33f01a111 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:28.430709 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41f86fdb-3280-4acd-bef0-91d33f01a111 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:28.431660 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41f86fdb-3280-4acd-bef0-91d33f01a111 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:28.432108 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41f86fdb-3280-4acd-bef0-91d33f01a111 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:28.432540 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41f86fdb-3280-4acd-bef0-91d33f01a111 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:28.565597 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-41f86fdb-3280-4acd-bef0-91d33f01a111 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:28.573664 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-41f86fdb-3280-4acd-bef0-91d33f01a111 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1366 microversion: 2.1 time: 0.162764 Aug 28 10:19:28.574233 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 225/430] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:28 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:28.954898 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-92600835-95fa-4c5c-bb01-4c9c57024c31 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:28.955944 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-92600835-95fa-4c5c-bb01-4c9c57024c31 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:28.966808 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-92600835-95fa-4c5c-bb01-4c9c57024c31 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:28.967612 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-92600835-95fa-4c5c-bb01-4c9c57024c31 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:28.968408 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-92600835-95fa-4c5c-bb01-4c9c57024c31 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:28.970316 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-92600835-95fa-4c5c-bb01-4c9c57024c31 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:28.971385 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-92600835-95fa-4c5c-bb01-4c9c57024c31 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:28.972089 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-92600835-95fa-4c5c-bb01-4c9c57024c31 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:29.117153 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-92600835-95fa-4c5c-bb01-4c9c57024c31 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:29.126525 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-92600835-95fa-4c5c-bb01-4c9c57024c31 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:29.128020 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-92600835-95fa-4c5c-bb01-4c9c57024c31 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:29.129208 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-92600835-95fa-4c5c-bb01-4c9c57024c31 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.180933 Aug 28 10:19:29.129863 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 206/431] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:28 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:29.594401 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cf338add-80c0-4b00-b630-eb8014cbb874 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:29.595006 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cf338add-80c0-4b00-b630-eb8014cbb874 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:29.601482 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cf338add-80c0-4b00-b630-eb8014cbb874 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:29.601964 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cf338add-80c0-4b00-b630-eb8014cbb874 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:29.602392 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cf338add-80c0-4b00-b630-eb8014cbb874 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:29.603159 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cf338add-80c0-4b00-b630-eb8014cbb874 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:29.603603 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cf338add-80c0-4b00-b630-eb8014cbb874 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:29.604018 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cf338add-80c0-4b00-b630-eb8014cbb874 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:29.744463 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cf338add-80c0-4b00-b630-eb8014cbb874 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:29.752815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cf338add-80c0-4b00-b630-eb8014cbb874 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1366 microversion: 2.1 time: 0.162315 Aug 28 10:19:29.753393 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 226/432] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:29 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:30.154193 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-117b0634-b9a5-4eee-a10d-f78206b82c0a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:30.154837 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-117b0634-b9a5-4eee-a10d-f78206b82c0a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:30.162074 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-117b0634-b9a5-4eee-a10d-f78206b82c0a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:30.162546 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-117b0634-b9a5-4eee-a10d-f78206b82c0a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:30.162999 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-117b0634-b9a5-4eee-a10d-f78206b82c0a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:30.163711 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-117b0634-b9a5-4eee-a10d-f78206b82c0a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:30.164177 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-117b0634-b9a5-4eee-a10d-f78206b82c0a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:30.165004 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-117b0634-b9a5-4eee-a10d-f78206b82c0a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:30.296115 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-117b0634-b9a5-4eee-a10d-f78206b82c0a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:30.307905 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-117b0634-b9a5-4eee-a10d-f78206b82c0a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:30.310147 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-117b0634-b9a5-4eee-a10d-f78206b82c0a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:30.311900 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-117b0634-b9a5-4eee-a10d-f78206b82c0a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.161885 Aug 28 10:19:30.312711 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 207/433] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:30 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:30.780091 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fc745b08-d7cd-45ba-8d97-82b3d10297a6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:30.780966 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fc745b08-d7cd-45ba-8d97-82b3d10297a6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:30.791320 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fc745b08-d7cd-45ba-8d97-82b3d10297a6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:30.792097 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fc745b08-d7cd-45ba-8d97-82b3d10297a6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:30.792862 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fc745b08-d7cd-45ba-8d97-82b3d10297a6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:30.793966 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fc745b08-d7cd-45ba-8d97-82b3d10297a6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:30.794691 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fc745b08-d7cd-45ba-8d97-82b3d10297a6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:30.795370 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fc745b08-d7cd-45ba-8d97-82b3d10297a6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:30.928453 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fc745b08-d7cd-45ba-8d97-82b3d10297a6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:30.936560 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fc745b08-d7cd-45ba-8d97-82b3d10297a6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1366 microversion: 2.1 time: 0.163140 Aug 28 10:19:30.937398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 227/434] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:30 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:31.339129 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-acef7356-67b6-442b-979c-e899e54ba648 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:31.340105 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-acef7356-67b6-442b-979c-e899e54ba648 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:31.351150 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-acef7356-67b6-442b-979c-e899e54ba648 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:31.351960 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-acef7356-67b6-442b-979c-e899e54ba648 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:31.352712 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-acef7356-67b6-442b-979c-e899e54ba648 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:31.353625 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-acef7356-67b6-442b-979c-e899e54ba648 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:31.354077 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-acef7356-67b6-442b-979c-e899e54ba648 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:31.354496 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-acef7356-67b6-442b-979c-e899e54ba648 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:31.488249 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-acef7356-67b6-442b-979c-e899e54ba648 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:31.496868 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-acef7356-67b6-442b-979c-e899e54ba648 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:31.498301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-acef7356-67b6-442b-979c-e899e54ba648 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:31.499487 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-acef7356-67b6-442b-979c-e899e54ba648 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.167078 Aug 28 10:19:31.500021 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 208/435] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:31 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:31.957541 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-04296200-a730-41a7-8a77-d2427118b2b8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:31.958112 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-04296200-a730-41a7-8a77-d2427118b2b8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:31.964411 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04296200-a730-41a7-8a77-d2427118b2b8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:31.964921 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04296200-a730-41a7-8a77-d2427118b2b8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:31.965340 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04296200-a730-41a7-8a77-d2427118b2b8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:31.966013 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04296200-a730-41a7-8a77-d2427118b2b8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:31.966452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04296200-a730-41a7-8a77-d2427118b2b8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:31.966861 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04296200-a730-41a7-8a77-d2427118b2b8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:32.103466 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-04296200-a730-41a7-8a77-d2427118b2b8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:32.111426 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-04296200-a730-41a7-8a77-d2427118b2b8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1366 microversion: 2.1 time: 0.157747 Aug 28 10:19:32.111988 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 228/436] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:31 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:32.522802 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-23431112-351a-4c0d-bd97-f787df8070f0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:32.523407 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-23431112-351a-4c0d-bd97-f787df8070f0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:32.530016 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-23431112-351a-4c0d-bd97-f787df8070f0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:32.530484 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-23431112-351a-4c0d-bd97-f787df8070f0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:32.530898 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-23431112-351a-4c0d-bd97-f787df8070f0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:32.531566 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-23431112-351a-4c0d-bd97-f787df8070f0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:32.532001 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-23431112-351a-4c0d-bd97-f787df8070f0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:32.532409 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-23431112-351a-4c0d-bd97-f787df8070f0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:32.663944 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-23431112-351a-4c0d-bd97-f787df8070f0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:32.673542 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-23431112-351a-4c0d-bd97-f787df8070f0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:32.674977 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-23431112-351a-4c0d-bd97-f787df8070f0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:32.676256 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-23431112-351a-4c0d-bd97-f787df8070f0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.157537 Aug 28 10:19:32.676839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 209/437] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:32 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:33.136256 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f6e4e156-0f3c-4e8e-94f4-c3be6e64264f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:33.137307 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f6e4e156-0f3c-4e8e-94f4-c3be6e64264f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:33.147205 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f6e4e156-0f3c-4e8e-94f4-c3be6e64264f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:33.147998 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f6e4e156-0f3c-4e8e-94f4-c3be6e64264f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:33.148774 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f6e4e156-0f3c-4e8e-94f4-c3be6e64264f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:33.149976 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f6e4e156-0f3c-4e8e-94f4-c3be6e64264f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:33.150424 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f6e4e156-0f3c-4e8e-94f4-c3be6e64264f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:33.150814 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f6e4e156-0f3c-4e8e-94f4-c3be6e64264f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:33.280641 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f6e4e156-0f3c-4e8e-94f4-c3be6e64264f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:33.288235 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f6e4e156-0f3c-4e8e-94f4-c3be6e64264f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1366 microversion: 2.1 time: 0.158543 Aug 28 10:19:33.288957 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 229/438] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:33 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:33.702890 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-daf71fd9-c405-402f-a693-22a7134e6775 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:33.703882 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-daf71fd9-c405-402f-a693-22a7134e6775 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:33.714271 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-daf71fd9-c405-402f-a693-22a7134e6775 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:33.714797 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-daf71fd9-c405-402f-a693-22a7134e6775 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:33.715220 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-daf71fd9-c405-402f-a693-22a7134e6775 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:33.715908 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-daf71fd9-c405-402f-a693-22a7134e6775 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:33.716353 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-daf71fd9-c405-402f-a693-22a7134e6775 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:33.716847 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-daf71fd9-c405-402f-a693-22a7134e6775 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:33.865423 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-daf71fd9-c405-402f-a693-22a7134e6775 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:33.874431 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-daf71fd9-c405-402f-a693-22a7134e6775 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:33.876011 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-daf71fd9-c405-402f-a693-22a7134e6775 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:33.877312 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-daf71fd9-c405-402f-a693-22a7134e6775 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.181153 Aug 28 10:19:33.877895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 210/439] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:33 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:34.313440 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-284297a0-c379-4235-b23f-a9f383dfde8a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:34.314389 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-284297a0-c379-4235-b23f-a9f383dfde8a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:34.323614 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-284297a0-c379-4235-b23f-a9f383dfde8a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:34.324099 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-284297a0-c379-4235-b23f-a9f383dfde8a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:34.324534 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-284297a0-c379-4235-b23f-a9f383dfde8a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:34.325231 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-284297a0-c379-4235-b23f-a9f383dfde8a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:34.325674 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-284297a0-c379-4235-b23f-a9f383dfde8a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:34.326087 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-284297a0-c379-4235-b23f-a9f383dfde8a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:34.468037 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-284297a0-c379-4235-b23f-a9f383dfde8a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:34.476025 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-284297a0-c379-4235-b23f-a9f383dfde8a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1366 microversion: 2.1 time: 0.169252 Aug 28 10:19:34.476625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 230/440] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:34 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:34.899792 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f1696d82-e1f2-45f9-8c05-c42ce5d5728d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:34.900367 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f1696d82-e1f2-45f9-8c05-c42ce5d5728d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:34.907052 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f1696d82-e1f2-45f9-8c05-c42ce5d5728d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:34.907529 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f1696d82-e1f2-45f9-8c05-c42ce5d5728d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:34.907988 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f1696d82-e1f2-45f9-8c05-c42ce5d5728d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:34.908774 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f1696d82-e1f2-45f9-8c05-c42ce5d5728d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:34.909219 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f1696d82-e1f2-45f9-8c05-c42ce5d5728d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:34.909633 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f1696d82-e1f2-45f9-8c05-c42ce5d5728d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:35.052419 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f1696d82-e1f2-45f9-8c05-c42ce5d5728d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:35.065056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f1696d82-e1f2-45f9-8c05-c42ce5d5728d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:35.067146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f1696d82-e1f2-45f9-8c05-c42ce5d5728d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:35.068789 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f1696d82-e1f2-45f9-8c05-c42ce5d5728d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.172705 Aug 28 10:19:35.069463 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 211/441] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:34 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:35.500898 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2881fa72-8164-4bbf-b9ac-e5d87d3a5a7b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:35.501912 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2881fa72-8164-4bbf-b9ac-e5d87d3a5a7b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:35.511712 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2881fa72-8164-4bbf-b9ac-e5d87d3a5a7b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:35.512193 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2881fa72-8164-4bbf-b9ac-e5d87d3a5a7b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:35.512661 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2881fa72-8164-4bbf-b9ac-e5d87d3a5a7b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:35.513347 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2881fa72-8164-4bbf-b9ac-e5d87d3a5a7b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:35.513791 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2881fa72-8164-4bbf-b9ac-e5d87d3a5a7b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:35.514210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2881fa72-8164-4bbf-b9ac-e5d87d3a5a7b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:35.641322 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2881fa72-8164-4bbf-b9ac-e5d87d3a5a7b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:35.649622 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2881fa72-8164-4bbf-b9ac-e5d87d3a5a7b tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1366 microversion: 2.1 time: 0.155357 Aug 28 10:19:35.650198 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 231/442] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:35 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:36.095414 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-ada88b29-d0fa-4afb-b311-35c6b21ccc37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:36.096392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-ada88b29-d0fa-4afb-b311-35c6b21ccc37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:36.106966 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ada88b29-d0fa-4afb-b311-35c6b21ccc37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:36.107765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ada88b29-d0fa-4afb-b311-35c6b21ccc37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:36.108462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ada88b29-d0fa-4afb-b311-35c6b21ccc37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:36.109618 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ada88b29-d0fa-4afb-b311-35c6b21ccc37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:36.110354 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ada88b29-d0fa-4afb-b311-35c6b21ccc37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:36.111039 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ada88b29-d0fa-4afb-b311-35c6b21ccc37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:36.248308 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-ada88b29-d0fa-4afb-b311-35c6b21ccc37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:36.257043 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-ada88b29-d0fa-4afb-b311-35c6b21ccc37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:36.258457 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-ada88b29-d0fa-4afb-b311-35c6b21ccc37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:36.259608 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-ada88b29-d0fa-4afb-b311-35c6b21ccc37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.170896 Aug 28 10:19:36.260171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 212/443] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:36 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:36.675086 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c35cc7d5-48a9-4022-9084-d00fb0ea1119 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:36.676069 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c35cc7d5-48a9-4022-9084-d00fb0ea1119 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:36.684940 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c35cc7d5-48a9-4022-9084-d00fb0ea1119 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:36.685422 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c35cc7d5-48a9-4022-9084-d00fb0ea1119 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:36.685845 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c35cc7d5-48a9-4022-9084-d00fb0ea1119 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:36.686530 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c35cc7d5-48a9-4022-9084-d00fb0ea1119 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:36.686971 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c35cc7d5-48a9-4022-9084-d00fb0ea1119 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:36.687383 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c35cc7d5-48a9-4022-9084-d00fb0ea1119 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:36.822550 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c35cc7d5-48a9-4022-9084-d00fb0ea1119 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:36.830562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c35cc7d5-48a9-4022-9084-d00fb0ea1119 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1366 microversion: 2.1 time: 0.162167 Aug 28 10:19:36.831173 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 232/444] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:36 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:37.286381 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-1e06b91c-5e32-4752-807e-f16b1e9cfe07 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:37.287210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-1e06b91c-5e32-4752-807e-f16b1e9cfe07 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:37.296044 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1e06b91c-5e32-4752-807e-f16b1e9cfe07 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:37.296498 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1e06b91c-5e32-4752-807e-f16b1e9cfe07 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:37.296989 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1e06b91c-5e32-4752-807e-f16b1e9cfe07 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:37.298126 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1e06b91c-5e32-4752-807e-f16b1e9cfe07 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:37.298126 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1e06b91c-5e32-4752-807e-f16b1e9cfe07 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:37.298511 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1e06b91c-5e32-4752-807e-f16b1e9cfe07 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:37.429116 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-1e06b91c-5e32-4752-807e-f16b1e9cfe07 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:37.437789 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-1e06b91c-5e32-4752-807e-f16b1e9cfe07 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:37.439210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-1e06b91c-5e32-4752-807e-f16b1e9cfe07 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:37.440360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-1e06b91c-5e32-4752-807e-f16b1e9cfe07 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.160803 Aug 28 10:19:37.440932 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 213/445] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:37 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:37.626804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-39939790-0de3-44c6-9b3c-caa02c354c56 req-5607d24f-9f3d-4efa-99ba-2d560390439d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a0819fc-2347-457b-804f-7ef819596193", "name": "network-vif-plugged", "status": "completed", "tag": "fe1c34ee-5586-4bd0-a9a5-7cc7349b7bd2"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:19:37.636672 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-39939790-0de3-44c6-9b3c-caa02c354c56 req-5607d24f-9f3d-4efa-99ba-2d560390439d service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:37.637226 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-39939790-0de3-44c6-9b3c-caa02c354c56 req-5607d24f-9f3d-4efa-99ba-2d560390439d service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:37.637637 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-39939790-0de3-44c6-9b3c-caa02c354c56 req-5607d24f-9f3d-4efa-99ba-2d560390439d service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:37.649912 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-39939790-0de3-44c6-9b3c-caa02c354c56 req-5607d24f-9f3d-4efa-99ba-2d560390439d service nova] Creating event network-vif-plugged:fe1c34ee-5586-4bd0-a9a5-7cc7349b7bd2 for instance 2a0819fc-2347-457b-804f-7ef819596193 on hv-cinder-85200 Aug 28 10:19:37.655158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-39939790-0de3-44c6-9b3c-caa02c354c56 req-5607d24f-9f3d-4efa-99ba-2d560390439d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032021 Aug 28 10:19:37.655891 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 233/446] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:19:37.855639 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e6bae512-37db-4406-8ac9-1f69206627eb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:37.856318 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e6bae512-37db-4406-8ac9-1f69206627eb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:37.864448 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e6bae512-37db-4406-8ac9-1f69206627eb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:37.865108 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e6bae512-37db-4406-8ac9-1f69206627eb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:37.865670 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e6bae512-37db-4406-8ac9-1f69206627eb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:37.866535 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e6bae512-37db-4406-8ac9-1f69206627eb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:37.867090 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e6bae512-37db-4406-8ac9-1f69206627eb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:37.867612 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e6bae512-37db-4406-8ac9-1f69206627eb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:38.002962 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-e6bae512-37db-4406-8ac9-1f69206627eb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:38.010903 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-e6bae512-37db-4406-8ac9-1f69206627eb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1366 microversion: 2.1 time: 0.160587 Aug 28 10:19:38.011467 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 214/447] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:37 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:38.466604 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c356dda6-2a03-496a-872f-1b6a67dbb4c0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:38.467421 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c356dda6-2a03-496a-872f-1b6a67dbb4c0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:38.475123 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c356dda6-2a03-496a-872f-1b6a67dbb4c0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:38.475685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c356dda6-2a03-496a-872f-1b6a67dbb4c0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:38.476162 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c356dda6-2a03-496a-872f-1b6a67dbb4c0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:38.477021 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c356dda6-2a03-496a-872f-1b6a67dbb4c0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:38.477545 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c356dda6-2a03-496a-872f-1b6a67dbb4c0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:38.478042 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c356dda6-2a03-496a-872f-1b6a67dbb4c0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:38.614488 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c356dda6-2a03-496a-872f-1b6a67dbb4c0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:38.622785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c356dda6-2a03-496a-872f-1b6a67dbb4c0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:38.624295 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c356dda6-2a03-496a-872f-1b6a67dbb4c0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:38.625471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c356dda6-2a03-496a-872f-1b6a67dbb4c0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.165110 Aug 28 10:19:38.626004 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 234/448] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:38 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:39.030607 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-703d1f86-a8f4-430e-aeaa-fb313f55742a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:39.031235 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-703d1f86-a8f4-430e-aeaa-fb313f55742a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:39.037971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-703d1f86-a8f4-430e-aeaa-fb313f55742a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:39.038434 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-703d1f86-a8f4-430e-aeaa-fb313f55742a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:39.038891 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-703d1f86-a8f4-430e-aeaa-fb313f55742a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:39.039589 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-703d1f86-a8f4-430e-aeaa-fb313f55742a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:39.040362 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-703d1f86-a8f4-430e-aeaa-fb313f55742a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:39.040831 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-703d1f86-a8f4-430e-aeaa-fb313f55742a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:39.185159 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-703d1f86-a8f4-430e-aeaa-fb313f55742a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:39.192979 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-703d1f86-a8f4-430e-aeaa-fb313f55742a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1366 microversion: 2.1 time: 0.166133 Aug 28 10:19:39.193572 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 215/449] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:39 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:39.648818 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-792fed8d-7781-4573-b945-9d2a6c717bd5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:39.649414 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-792fed8d-7781-4573-b945-9d2a6c717bd5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:39.655782 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-792fed8d-7781-4573-b945-9d2a6c717bd5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:39.656253 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-792fed8d-7781-4573-b945-9d2a6c717bd5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:39.656712 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-792fed8d-7781-4573-b945-9d2a6c717bd5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:39.657394 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-792fed8d-7781-4573-b945-9d2a6c717bd5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:39.657836 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-792fed8d-7781-4573-b945-9d2a6c717bd5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:39.658246 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-792fed8d-7781-4573-b945-9d2a6c717bd5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:39.792008 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-792fed8d-7781-4573-b945-9d2a6c717bd5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:39.800155 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-792fed8d-7781-4573-b945-9d2a6c717bd5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:39.801613 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-792fed8d-7781-4573-b945-9d2a6c717bd5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:39.802747 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-792fed8d-7781-4573-b945-9d2a6c717bd5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1745 microversion: 2.20 time: 0.158016 Aug 28 10:19:39.803282 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 235/450] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:39 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:40.213855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-2f64ee88-05ec-4eeb-b983-d7dc80de1c5a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:40.214469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-2f64ee88-05ec-4eeb-b983-d7dc80de1c5a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:40.221387 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2f64ee88-05ec-4eeb-b983-d7dc80de1c5a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:40.221868 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2f64ee88-05ec-4eeb-b983-d7dc80de1c5a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:40.222291 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2f64ee88-05ec-4eeb-b983-d7dc80de1c5a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:40.222975 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2f64ee88-05ec-4eeb-b983-d7dc80de1c5a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:40.223419 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2f64ee88-05ec-4eeb-b983-d7dc80de1c5a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:40.223834 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2f64ee88-05ec-4eeb-b983-d7dc80de1c5a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:40.353844 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-2f64ee88-05ec-4eeb-b983-d7dc80de1c5a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:40.365602 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-2f64ee88-05ec-4eeb-b983-d7dc80de1c5a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1366 microversion: 2.1 time: 0.155272 Aug 28 10:19:40.366392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 216/451] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:40 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:40.830449 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a3d07682-d313-4312-817f-e53ea42f0ee2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:40.831365 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a3d07682-d313-4312-817f-e53ea42f0ee2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:40.841532 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a3d07682-d313-4312-817f-e53ea42f0ee2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:40.842322 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a3d07682-d313-4312-817f-e53ea42f0ee2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:40.843126 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a3d07682-d313-4312-817f-e53ea42f0ee2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:40.844151 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a3d07682-d313-4312-817f-e53ea42f0ee2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:40.844943 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a3d07682-d313-4312-817f-e53ea42f0ee2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:40.845631 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a3d07682-d313-4312-817f-e53ea42f0ee2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:41.000144 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a3d07682-d313-4312-817f-e53ea42f0ee2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:41.008926 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a3d07682-d313-4312-817f-e53ea42f0ee2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:41.010400 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a3d07682-d313-4312-817f-e53ea42f0ee2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:41.011536 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a3d07682-d313-4312-817f-e53ea42f0ee2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1745 microversion: 2.20 time: 0.187820 Aug 28 10:19:41.012102 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 236/452] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:40 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1745 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:41.391991 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-a20c96ef-ed31-4a8f-913b-2ed4879265ac tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:41.393011 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-a20c96ef-ed31-4a8f-913b-2ed4879265ac tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:41.402908 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a20c96ef-ed31-4a8f-913b-2ed4879265ac tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:41.403390 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a20c96ef-ed31-4a8f-913b-2ed4879265ac tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:41.403822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a20c96ef-ed31-4a8f-913b-2ed4879265ac tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:41.404536 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a20c96ef-ed31-4a8f-913b-2ed4879265ac tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:41.404993 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a20c96ef-ed31-4a8f-913b-2ed4879265ac tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:41.405412 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a20c96ef-ed31-4a8f-913b-2ed4879265ac tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:41.542973 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-a20c96ef-ed31-4a8f-913b-2ed4879265ac tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:41.554451 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-a20c96ef-ed31-4a8f-913b-2ed4879265ac tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1366 microversion: 2.1 time: 0.169047 Aug 28 10:19:41.555017 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 217/453] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:41 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:41.951802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-266b5434-c743-41c2-8afd-1961e66df147 req-83b01536-0f9b-47de-915c-1b8c2f7ee031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "109322c8-1668-4c81-bac7-b05bfacf1709", "name": "network-vif-plugged", "status": "completed", "tag": "beb69a75-9bbc-4b73-b637-809ea041054b"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:19:41.961298 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-266b5434-c743-41c2-8afd-1961e66df147 req-83b01536-0f9b-47de-915c-1b8c2f7ee031 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:41.961753 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-266b5434-c743-41c2-8afd-1961e66df147 req-83b01536-0f9b-47de-915c-1b8c2f7ee031 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:41.962180 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-266b5434-c743-41c2-8afd-1961e66df147 req-83b01536-0f9b-47de-915c-1b8c2f7ee031 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:41.973822 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-266b5434-c743-41c2-8afd-1961e66df147 req-83b01536-0f9b-47de-915c-1b8c2f7ee031 service nova] Creating event network-vif-plugged:beb69a75-9bbc-4b73-b637-809ea041054b for instance 109322c8-1668-4c81-bac7-b05bfacf1709 on hv-cinder-85200 Aug 28 10:19:41.978668 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-266b5434-c743-41c2-8afd-1961e66df147 req-83b01536-0f9b-47de-915c-1b8c2f7ee031 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030703 Aug 28 10:19:41.979267 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 237/454] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:19:42.034290 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-104421e9-0ea9-4c34-a903-707ed495ac2e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:42.034891 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-104421e9-0ea9-4c34-a903-707ed495ac2e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:42.041383 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-104421e9-0ea9-4c34-a903-707ed495ac2e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:42.041858 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-104421e9-0ea9-4c34-a903-707ed495ac2e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:42.042266 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-104421e9-0ea9-4c34-a903-707ed495ac2e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:42.042940 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-104421e9-0ea9-4c34-a903-707ed495ac2e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:42.043373 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-104421e9-0ea9-4c34-a903-707ed495ac2e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:42.043751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-104421e9-0ea9-4c34-a903-707ed495ac2e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:42.178114 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-104421e9-0ea9-4c34-a903-707ed495ac2e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:42.189173 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-104421e9-0ea9-4c34-a903-707ed495ac2e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:42.190790 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-104421e9-0ea9-4c34-a903-707ed495ac2e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:42.191979 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-104421e9-0ea9-4c34-a903-707ed495ac2e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1745 microversion: 2.20 time: 0.161644 Aug 28 10:19:42.192558 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 218/455] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:42 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:42.580063 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9f36e182-e90a-4084-b8ee-3dc7997045c1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:42.581337 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9f36e182-e90a-4084-b8ee-3dc7997045c1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:42.591482 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f36e182-e90a-4084-b8ee-3dc7997045c1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:42.591959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f36e182-e90a-4084-b8ee-3dc7997045c1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:42.592379 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f36e182-e90a-4084-b8ee-3dc7997045c1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:42.593212 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f36e182-e90a-4084-b8ee-3dc7997045c1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:42.594296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f36e182-e90a-4084-b8ee-3dc7997045c1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:42.594296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f36e182-e90a-4084-b8ee-3dc7997045c1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:42.732124 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9f36e182-e90a-4084-b8ee-3dc7997045c1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:42.743826 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9f36e182-e90a-4084-b8ee-3dc7997045c1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1366 microversion: 2.1 time: 0.170750 Aug 28 10:19:42.744646 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 238/456] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:42 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:43.215550 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-908a6926-9eda-467e-ae6f-b1d965c53e0e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:43.216174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-908a6926-9eda-467e-ae6f-b1d965c53e0e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:43.218542 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:43.223989 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-908a6926-9eda-467e-ae6f-b1d965c53e0e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:43.224467 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-908a6926-9eda-467e-ae6f-b1d965c53e0e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:43.224919 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-908a6926-9eda-467e-ae6f-b1d965c53e0e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:43.225599 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-908a6926-9eda-467e-ae6f-b1d965c53e0e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:43.226040 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-908a6926-9eda-467e-ae6f-b1d965c53e0e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:43.226452 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-908a6926-9eda-467e-ae6f-b1d965c53e0e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:43.379971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-908a6926-9eda-467e-ae6f-b1d965c53e0e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:43.388801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-908a6926-9eda-467e-ae6f-b1d965c53e0e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:43.390225 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-908a6926-9eda-467e-ae6f-b1d965c53e0e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:43.391400 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-908a6926-9eda-467e-ae6f-b1d965c53e0e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1745 microversion: 2.20 time: 0.179875 Aug 28 10:19:43.391967 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 219/457] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:43 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:43.422276 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bb902a4b-41bb-4e1e-a2c6-96da9019eed4 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:43.422776 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bb902a4b-41bb-4e1e-a2c6-96da9019eed4 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 78c1fa2f-a973-4e1d-834a-c037b6272109] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:43.428830 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb902a4b-41bb-4e1e-a2c6-96da9019eed4 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:43.429298 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb902a4b-41bb-4e1e-a2c6-96da9019eed4 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:43.429714 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb902a4b-41bb-4e1e-a2c6-96da9019eed4 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:43.430387 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb902a4b-41bb-4e1e-a2c6-96da9019eed4 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:43.430821 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb902a4b-41bb-4e1e-a2c6-96da9019eed4 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:43.431227 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb902a4b-41bb-4e1e-a2c6-96da9019eed4 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:43.576766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-bb902a4b-41bb-4e1e-a2c6-96da9019eed4 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lazy-loading 'services' on Instance uuid 78c1fa2f-a973-4e1d-834a-c037b6272109 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:19:43.703337 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bb902a4b-41bb-4e1e-a2c6-96da9019eed4 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "DELETE /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109/os-volume_attachments/5b1b1ab7-26df-4c47-837d-30ddda85f5bc" status: 202 len: 0 microversion: 2.1 time: 0.285041 Aug 28 10:19:43.703942 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 239/458] 10.222.0.40 () {58 vars in 1416 bytes} [Sun Aug 28 10:19:43 2022] DELETE /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109/os-volume_attachments/5b1b1ab7-26df-4c47-837d-30ddda85f5bc => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:19:43.764243 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-d04ac685-a72f-4170-a4f2-2e5bde824489 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:43.764822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-d04ac685-a72f-4170-a4f2-2e5bde824489 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:43.771055 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d04ac685-a72f-4170-a4f2-2e5bde824489 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:43.771529 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d04ac685-a72f-4170-a4f2-2e5bde824489 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:43.771947 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d04ac685-a72f-4170-a4f2-2e5bde824489 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:43.772671 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d04ac685-a72f-4170-a4f2-2e5bde824489 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:43.773110 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d04ac685-a72f-4170-a4f2-2e5bde824489 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:43.773573 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d04ac685-a72f-4170-a4f2-2e5bde824489 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:43.902748 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d04ac685-a72f-4170-a4f2-2e5bde824489 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:43.911763 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-d04ac685-a72f-4170-a4f2-2e5bde824489 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1366 microversion: 2.1 time: 0.151495 Aug 28 10:19:43.912339 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 220/459] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:43 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:44.419577 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bcc2ec96-3dae-485b-b967-0f4749df9083 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:44.420262 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bcc2ec96-3dae-485b-b967-0f4749df9083 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:44.427447 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bcc2ec96-3dae-485b-b967-0f4749df9083 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:44.428045 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bcc2ec96-3dae-485b-b967-0f4749df9083 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:44.428317 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bcc2ec96-3dae-485b-b967-0f4749df9083 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:44.429025 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bcc2ec96-3dae-485b-b967-0f4749df9083 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:44.429468 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bcc2ec96-3dae-485b-b967-0f4749df9083 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:44.429863 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bcc2ec96-3dae-485b-b967-0f4749df9083 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:44.432425 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:44.566127 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bcc2ec96-3dae-485b-b967-0f4749df9083 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:44.575004 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bcc2ec96-3dae-485b-b967-0f4749df9083 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:44.576416 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bcc2ec96-3dae-485b-b967-0f4749df9083 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:44.577576 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bcc2ec96-3dae-485b-b967-0f4749df9083 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1745 microversion: 2.20 time: 0.165234 Aug 28 10:19:44.578370 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 240/460] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:44 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:44.935607 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-baee6542-9109-4872-a29b-cedaae71996e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:44.936170 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-baee6542-9109-4872-a29b-cedaae71996e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:44.942907 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-baee6542-9109-4872-a29b-cedaae71996e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:44.943374 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-baee6542-9109-4872-a29b-cedaae71996e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:44.943800 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-baee6542-9109-4872-a29b-cedaae71996e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:44.944474 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-baee6542-9109-4872-a29b-cedaae71996e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:44.944935 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-baee6542-9109-4872-a29b-cedaae71996e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:44.945350 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-baee6542-9109-4872-a29b-cedaae71996e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:45.089223 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-baee6542-9109-4872-a29b-cedaae71996e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:45.097534 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-baee6542-9109-4872-a29b-cedaae71996e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1555 microversion: 2.1 time: 0.167815 Aug 28 10:19:45.098129 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 221/461] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:44 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:45.125942 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-992ba98f-d56d-4c9a-bac3-015fa05c801d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:45.126464 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-992ba98f-d56d-4c9a-bac3-015fa05c801d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:45.132756 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-992ba98f-d56d-4c9a-bac3-015fa05c801d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:45.133645 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-992ba98f-d56d-4c9a-bac3-015fa05c801d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:45.133645 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-992ba98f-d56d-4c9a-bac3-015fa05c801d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:45.134303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-992ba98f-d56d-4c9a-bac3-015fa05c801d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:45.134815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-992ba98f-d56d-4c9a-bac3-015fa05c801d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:45.135190 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-992ba98f-d56d-4c9a-bac3-015fa05c801d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:45.214099 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-992ba98f-d56d-4c9a-bac3-015fa05c801d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092184 Aug 28 10:19:45.214767 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 241/462] 10.222.0.40 () {58 vars in 1275 bytes} [Sun Aug 28 10:19:45 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:19:45.600354 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-40769ddf-5ae9-4bd9-8f19-73867f7ea4ee tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:45.601074 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-40769ddf-5ae9-4bd9-8f19-73867f7ea4ee tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:45.607537 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-40769ddf-5ae9-4bd9-8f19-73867f7ea4ee tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:45.608229 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-40769ddf-5ae9-4bd9-8f19-73867f7ea4ee tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:45.608779 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-40769ddf-5ae9-4bd9-8f19-73867f7ea4ee tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:45.609625 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-40769ddf-5ae9-4bd9-8f19-73867f7ea4ee tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:45.610091 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-40769ddf-5ae9-4bd9-8f19-73867f7ea4ee tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:45.610566 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-40769ddf-5ae9-4bd9-8f19-73867f7ea4ee tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:45.613367 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=100 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:45.855593 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-40769ddf-5ae9-4bd9-8f19-73867f7ea4ee tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:45.866916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-40769ddf-5ae9-4bd9-8f19-73867f7ea4ee tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:45.869019 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-40769ddf-5ae9-4bd9-8f19-73867f7ea4ee tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:45.870217 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-40769ddf-5ae9-4bd9-8f19-73867f7ea4ee tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1740 microversion: 2.20 time: 0.274239 Aug 28 10:19:45.881720 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 222/463] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:45 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1740 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:46.239465 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-7f6104e3-fb8d-419b-9ba4-4e7a1f2c75c6 req-69df4be6-094f-409d-a207-44cd941b71e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "109322c8-1668-4c81-bac7-b05bfacf1709", "tag": "beb69a75-9bbc-4b73-b637-809ea041054b"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:19:46.252091 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7f6104e3-fb8d-419b-9ba4-4e7a1f2c75c6 req-69df4be6-094f-409d-a207-44cd941b71e0 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:46.253374 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7f6104e3-fb8d-419b-9ba4-4e7a1f2c75c6 req-69df4be6-094f-409d-a207-44cd941b71e0 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:46.254220 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7f6104e3-fb8d-419b-9ba4-4e7a1f2c75c6 req-69df4be6-094f-409d-a207-44cd941b71e0 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:46.266954 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-7f6104e3-fb8d-419b-9ba4-4e7a1f2c75c6 req-69df4be6-094f-409d-a207-44cd941b71e0 service nova] Creating event network-changed:beb69a75-9bbc-4b73-b637-809ea041054b for instance 109322c8-1668-4c81-bac7-b05bfacf1709 on hv-cinder-85200 Aug 28 10:19:46.272349 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-7f6104e3-fb8d-419b-9ba4-4e7a1f2c75c6 req-69df4be6-094f-409d-a207-44cd941b71e0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037014 Aug 28 10:19:46.273663 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 242/464] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:19:46.897307 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-b8a25fa2-a095-41d1-8247-251cd874538c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:46.898040 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-b8a25fa2-a095-41d1-8247-251cd874538c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:46.910923 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b8a25fa2-a095-41d1-8247-251cd874538c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:46.914221 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b8a25fa2-a095-41d1-8247-251cd874538c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:46.915272 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b8a25fa2-a095-41d1-8247-251cd874538c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:46.916278 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b8a25fa2-a095-41d1-8247-251cd874538c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:46.918123 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b8a25fa2-a095-41d1-8247-251cd874538c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:46.918859 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b8a25fa2-a095-41d1-8247-251cd874538c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:47.003893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2a0f35f1-c12e-46e8-b2d3-57cf68bbfe57 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:47.004672 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2a0f35f1-c12e-46e8-b2d3-57cf68bbfe57 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 78c1fa2f-a973-4e1d-834a-c037b6272109] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:47.018108 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2a0f35f1-c12e-46e8-b2d3-57cf68bbfe57 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:47.018771 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2a0f35f1-c12e-46e8-b2d3-57cf68bbfe57 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:47.020040 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2a0f35f1-c12e-46e8-b2d3-57cf68bbfe57 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:47.020891 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2a0f35f1-c12e-46e8-b2d3-57cf68bbfe57 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:47.021718 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2a0f35f1-c12e-46e8-b2d3-57cf68bbfe57 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:47.023040 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2a0f35f1-c12e-46e8-b2d3-57cf68bbfe57 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:47.060156 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2a0f35f1-c12e-46e8-b2d3-57cf68bbfe57 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 78c1fa2f-a973-4e1d-834a-c037b6272109] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 28 10:19:47.117436 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-b8a25fa2-a095-41d1-8247-251cd874538c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:47.130064 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-b8a25fa2-a095-41d1-8247-251cd874538c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:47.133250 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-b8a25fa2-a095-41d1-8247-251cd874538c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:47.135345 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-b8a25fa2-a095-41d1-8247-251cd874538c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1740 microversion: 2.20 time: 0.243863 Aug 28 10:19:47.137299 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 223/465] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:46 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1740 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:47.200923 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2a0f35f1-c12e-46e8-b2d3-57cf68bbfe57 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "DELETE /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109" status: 204 len: 0 microversion: 2.1 time: 0.203641 Aug 28 10:19:47.201617 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 243/466] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:19:46 2022] DELETE /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 28 10:19:47.210441 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-9c47f1dd-2418-4ec9-88f7-7147f0563e91 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:47.211181 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-9c47f1dd-2418-4ec9-88f7-7147f0563e91 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 78c1fa2f-a973-4e1d-834a-c037b6272109] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:47.218645 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9c47f1dd-2418-4ec9-88f7-7147f0563e91 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:47.219533 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9c47f1dd-2418-4ec9-88f7-7147f0563e91 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:47.220101 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9c47f1dd-2418-4ec9-88f7-7147f0563e91 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:47.220970 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9c47f1dd-2418-4ec9-88f7-7147f0563e91 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:47.221507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9c47f1dd-2418-4ec9-88f7-7147f0563e91 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:47.222140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9c47f1dd-2418-4ec9-88f7-7147f0563e91 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:47.412911 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-9c47f1dd-2418-4ec9-88f7-7147f0563e91 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:47.433993 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-9c47f1dd-2418-4ec9-88f7-7147f0563e91 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109" status: 200 len: 1514 microversion: 2.1 time: 0.225324 Aug 28 10:19:47.435615 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 224/467] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:47 2022] GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109 => generated 1514 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:19:48.160954 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-eeff4de8-cbfa-4659-bcd2-9e580ede7c74 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:48.162586 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-eeff4de8-cbfa-4659-bcd2-9e580ede7c74 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:48.166665 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:48.170400 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eeff4de8-cbfa-4659-bcd2-9e580ede7c74 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:48.170993 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eeff4de8-cbfa-4659-bcd2-9e580ede7c74 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:48.171483 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eeff4de8-cbfa-4659-bcd2-9e580ede7c74 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:48.172287 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eeff4de8-cbfa-4659-bcd2-9e580ede7c74 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:48.172763 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eeff4de8-cbfa-4659-bcd2-9e580ede7c74 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:48.173272 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eeff4de8-cbfa-4659-bcd2-9e580ede7c74 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:48.332548 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-eeff4de8-cbfa-4659-bcd2-9e580ede7c74 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:48.361186 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-eeff4de8-cbfa-4659-bcd2-9e580ede7c74 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:48.362992 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-eeff4de8-cbfa-4659-bcd2-9e580ede7c74 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:48.366661 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-eeff4de8-cbfa-4659-bcd2-9e580ede7c74 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1740 microversion: 2.20 time: 0.210182 Aug 28 10:19:48.367505 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 244/468] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:48 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:48.465918 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-48342475-3c1a-495f-aa04-c1ea7a8dbeb8 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:48.467482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-48342475-3c1a-495f-aa04-c1ea7a8dbeb8 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 78c1fa2f-a973-4e1d-834a-c037b6272109] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:48.481137 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-48342475-3c1a-495f-aa04-c1ea7a8dbeb8 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:48.481906 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-48342475-3c1a-495f-aa04-c1ea7a8dbeb8 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:48.482489 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-48342475-3c1a-495f-aa04-c1ea7a8dbeb8 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:48.483347 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-48342475-3c1a-495f-aa04-c1ea7a8dbeb8 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:48.483936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-48342475-3c1a-495f-aa04-c1ea7a8dbeb8 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:48.484531 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-48342475-3c1a-495f-aa04-c1ea7a8dbeb8 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:48.639992 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-48342475-3c1a-495f-aa04-c1ea7a8dbeb8 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:48.648066 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-48342475-3c1a-495f-aa04-c1ea7a8dbeb8 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109" status: 200 len: 1514 microversion: 2.1 time: 0.196488 Aug 28 10:19:48.649521 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 225/469] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:48 2022] GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109 => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:49.391515 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bed1e463-e598-498e-8533-9a0d314a07a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:49.392266 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bed1e463-e598-498e-8533-9a0d314a07a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:49.398595 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bed1e463-e598-498e-8533-9a0d314a07a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:49.399067 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bed1e463-e598-498e-8533-9a0d314a07a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:49.399667 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bed1e463-e598-498e-8533-9a0d314a07a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:49.400618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bed1e463-e598-498e-8533-9a0d314a07a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:49.401006 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bed1e463-e598-498e-8533-9a0d314a07a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:49.401423 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bed1e463-e598-498e-8533-9a0d314a07a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:49.546358 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bed1e463-e598-498e-8533-9a0d314a07a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:49.560190 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bed1e463-e598-498e-8533-9a0d314a07a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:49.561735 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bed1e463-e598-498e-8533-9a0d314a07a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:49.562936 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bed1e463-e598-498e-8533-9a0d314a07a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1740 microversion: 2.20 time: 0.175446 Aug 28 10:19:49.564516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 245/470] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:49 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:49.671383 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-65fefcdb-6db0-4758-8481-072f00832541 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:49.672029 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-65fefcdb-6db0-4758-8481-072f00832541 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 78c1fa2f-a973-4e1d-834a-c037b6272109] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:49.679755 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-65fefcdb-6db0-4758-8481-072f00832541 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:49.680243 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-65fefcdb-6db0-4758-8481-072f00832541 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:49.680700 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-65fefcdb-6db0-4758-8481-072f00832541 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:49.681395 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-65fefcdb-6db0-4758-8481-072f00832541 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:49.682130 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-65fefcdb-6db0-4758-8481-072f00832541 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:49.682552 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-65fefcdb-6db0-4758-8481-072f00832541 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:49.829184 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-65fefcdb-6db0-4758-8481-072f00832541 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:49.839283 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-65fefcdb-6db0-4758-8481-072f00832541 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109" status: 200 len: 1514 microversion: 2.1 time: 0.171792 Aug 28 10:19:49.840637 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 226/471] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:49 2022] GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:50.041651 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-27784e2c-7f02-4649-8ddf-f9117ab3129e req-39ff42cf-42e2-42ba-9ed9-5a19dce959e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c1fa2f-a973-4e1d-834a-c037b6272109", "name": "network-vif-deleted", "tag": "44d55a67-5c66-4b90-b2a4-3a07f3c92fdb"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:19:50.066873 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-27784e2c-7f02-4649-8ddf-f9117ab3129e req-39ff42cf-42e2-42ba-9ed9-5a19dce959e9 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:50.067387 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-27784e2c-7f02-4649-8ddf-f9117ab3129e req-39ff42cf-42e2-42ba-9ed9-5a19dce959e9 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:50.067771 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-27784e2c-7f02-4649-8ddf-f9117ab3129e req-39ff42cf-42e2-42ba-9ed9-5a19dce959e9 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:50.080430 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-27784e2c-7f02-4649-8ddf-f9117ab3129e req-39ff42cf-42e2-42ba-9ed9-5a19dce959e9 service nova] Creating event network-vif-deleted:44d55a67-5c66-4b90-b2a4-3a07f3c92fdb for instance 78c1fa2f-a973-4e1d-834a-c037b6272109 on hv-cinder-85200 Aug 28 10:19:50.085324 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-27784e2c-7f02-4649-8ddf-f9117ab3129e req-39ff42cf-42e2-42ba-9ed9-5a19dce959e9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048657 Aug 28 10:19:50.089112 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 246/472] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:19:50.586189 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-82b4d78d-03ff-4814-804b-66380900f485 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:50.586899 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-82b4d78d-03ff-4814-804b-66380900f485 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:50.593457 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-82b4d78d-03ff-4814-804b-66380900f485 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:50.594212 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-82b4d78d-03ff-4814-804b-66380900f485 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:50.594854 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-82b4d78d-03ff-4814-804b-66380900f485 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:50.595741 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-82b4d78d-03ff-4814-804b-66380900f485 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:50.596383 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-82b4d78d-03ff-4814-804b-66380900f485 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:50.596839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-82b4d78d-03ff-4814-804b-66380900f485 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:50.747629 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-82b4d78d-03ff-4814-804b-66380900f485 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:50.758481 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-82b4d78d-03ff-4814-804b-66380900f485 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:50.760061 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-82b4d78d-03ff-4814-804b-66380900f485 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:50.761266 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-82b4d78d-03ff-4814-804b-66380900f485 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1740 microversion: 2.20 time: 0.179058 Aug 28 10:19:50.762256 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 227/473] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:50 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:50.862034 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-eaab03e7-78ff-45db-a3d7-75a5f4dd8068 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:50.862741 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-eaab03e7-78ff-45db-a3d7-75a5f4dd8068 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 78c1fa2f-a973-4e1d-834a-c037b6272109] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:50.869683 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eaab03e7-78ff-45db-a3d7-75a5f4dd8068 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:50.870191 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eaab03e7-78ff-45db-a3d7-75a5f4dd8068 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:50.870649 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eaab03e7-78ff-45db-a3d7-75a5f4dd8068 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:50.871696 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eaab03e7-78ff-45db-a3d7-75a5f4dd8068 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:50.872323 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eaab03e7-78ff-45db-a3d7-75a5f4dd8068 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:50.872772 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eaab03e7-78ff-45db-a3d7-75a5f4dd8068 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:50.909688 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eaab03e7-78ff-45db-a3d7-75a5f4dd8068 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:50.910291 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eaab03e7-78ff-45db-a3d7-75a5f4dd8068 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:50.910717 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eaab03e7-78ff-45db-a3d7-75a5f4dd8068 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:50.911153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-eaab03e7-78ff-45db-a3d7-75a5f4dd8068 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lazy-loading 'fault' on Instance uuid 78c1fa2f-a973-4e1d-834a-c037b6272109 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:19:50.954191 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-eaab03e7-78ff-45db-a3d7-75a5f4dd8068 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:50.963426 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-eaab03e7-78ff-45db-a3d7-75a5f4dd8068 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109" status: 200 len: 1308 microversion: 2.1 time: 0.106494 Aug 28 10:19:50.964228 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 247/474] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:50 2022] GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109 => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:19:51.783612 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-1ea076f4-6ac3-40f5-b550-20bed991043b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:51.784200 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-1ea076f4-6ac3-40f5-b550-20bed991043b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:51.791349 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1ea076f4-6ac3-40f5-b550-20bed991043b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:51.791840 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1ea076f4-6ac3-40f5-b550-20bed991043b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:51.792564 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1ea076f4-6ac3-40f5-b550-20bed991043b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:51.793379 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1ea076f4-6ac3-40f5-b550-20bed991043b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:51.793925 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1ea076f4-6ac3-40f5-b550-20bed991043b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:51.794408 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1ea076f4-6ac3-40f5-b550-20bed991043b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:51.931936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-1ea076f4-6ac3-40f5-b550-20bed991043b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:51.940688 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-1ea076f4-6ac3-40f5-b550-20bed991043b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:51.942459 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-1ea076f4-6ac3-40f5-b550-20bed991043b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:51.943724 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-1ea076f4-6ac3-40f5-b550-20bed991043b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1740 microversion: 2.20 time: 0.164165 Aug 28 10:19:51.944384 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 228/475] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:51 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 28 10:19:51.984902 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c748d4ef-52b2-4879-9df7-f3d897c1a69b tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:51.985508 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c748d4ef-52b2-4879-9df7-f3d897c1a69b tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 78c1fa2f-a973-4e1d-834a-c037b6272109] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:51.991935 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c748d4ef-52b2-4879-9df7-f3d897c1a69b tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:51.992416 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c748d4ef-52b2-4879-9df7-f3d897c1a69b tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:51.992883 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c748d4ef-52b2-4879-9df7-f3d897c1a69b tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:51.993571 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c748d4ef-52b2-4879-9df7-f3d897c1a69b tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:51.994043 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c748d4ef-52b2-4879-9df7-f3d897c1a69b tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:51.994452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c748d4ef-52b2-4879-9df7-f3d897c1a69b tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:52.008129 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-c748d4ef-52b2-4879-9df7-f3d897c1a69b tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] HTTP exception thrown: Instance 78c1fa2f-a973-4e1d-834a-c037b6272109 could not be found. Aug 28 10:19:52.009802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c748d4ef-52b2-4879-9df7-f3d897c1a69b tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Request method failure captured: Aug 28 10:19:52.009802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109 HTTP/1.1 Aug 28 10:19:52.009802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:19:52.009802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:19:52.009802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:19:52.009802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:19:52.009802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:19:52.009802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:19:52.009802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:19:52.009802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:19:52.009802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0DtzJxoOOP7G3JW6cwenUBOj2WcPmsG_7nh-ePGwWMXyp2WXR4pDXizUpoquyPp7DINX1QP0rlchuPg5oyuZbyX8-1CwdSisRNEvOfQ9eFlEvt5DEQKV8vxYree7IH9fsMKo8edOBAA5ObKdDGCZ_Xn1m8bD96sS3Zkx5mJHcf3MlU Aug 28 10:19:52.009802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:19:52.009802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:19:52.009802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:19:52.009802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:19:52.009802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:19:52.009802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:19:52.009802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 04c4f12270d54d5784bb9a12aced18c2 Aug 28 10:19:52.009802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesSnapshotTestJSON-863429265 Aug 28 10:19:52.009802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:19:52.009802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:19:52.011402 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_04c4f12270d54d5784bb9a12aced18c2", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/04c4f12270d54d5784bb9a12aced18c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/04c4f12270d54d5784bb9a12aced18c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/04c4f12270d54d5784bb9a12aced18c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:19:52.011402 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesSnapshotTestJSON-863429265 Aug 28 10:19:52.011402 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 04c4f12270d54d5784bb9a12aced18c2 Aug 28 10:19:52.011402 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-863429265 Aug 28 10:19:52.011402 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesSnapshotTestJSON-863429265-project Aug 28 10:19:52.011402 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:19:52.011402 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:19:52.011402 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: 538b5483267549e6be369a653928b4b9 Aug 28 10:19:52.011402 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesSnapshotTestJSON-863429265-project Aug 28 10:19:52.011402 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: > Aug 28 10:19:52.011402 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Instance 78c1fa2f-a973-4e1d-834a-c037b6272109 could not be found. Aug 28 10:19:52.011402 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '78c1fa2f-a973-4e1d-834a-c037b6272109'} Aug 28 10:19:52.012361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:19:52.012361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:19:52.012361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:19:52.012361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:19:52.012361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:19:52.012361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:19:52.012361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:19:52.012361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:19:52.012361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:19:52.012361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:19:52.012361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c1fa2f-a973-4e1d-834a-c037b6272109 could not be found. Aug 28 10:19:52.012361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:19:52.012361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:19:52.012361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:19:52.012361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:19:52.012361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:19:52.012361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:19:52.012361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:19:52.012361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:19:52.012361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:19:52.013665 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:19:52.013665 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:19:52.013665 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:19:52.013665 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:19:52.013665 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:19:52.013665 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:19:52.013665 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:19:52.013665 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c1fa2f-a973-4e1d-834a-c037b6272109 could not be found. Aug 28 10:19:52.013665 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:19:52.013665 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:19:52.013665 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:19:52.013665 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:19:52.013665 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:19:52.013665 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:19:52.013665 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:19:52.013665 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:19:52.013665 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c1fa2f-a973-4e1d-834a-c037b6272109 could not be found. Aug 28 10:19:52.013665 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:19:52.014732 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c748d4ef-52b2-4879-9df7-f3d897c1a69b tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Returning 404 to user: Instance 78c1fa2f-a973-4e1d-834a-c037b6272109 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:19:52.014732 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c748d4ef-52b2-4879-9df7-f3d897c1a69b tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109" status: 404 len: 111 microversion: 2.1 time: 0.030390 Aug 28 10:19:52.014732 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 248/476] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:19:51 2022] GET /compute/v2.1/servers/78c1fa2f-a973-4e1d-834a-c037b6272109 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:19:52.967689 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-5c7754bb-4857-4393-9562-d2ef34185924 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:52.969112 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-5c7754bb-4857-4393-9562-d2ef34185924 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:52.976916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5c7754bb-4857-4393-9562-d2ef34185924 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:52.977598 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5c7754bb-4857-4393-9562-d2ef34185924 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:52.978226 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5c7754bb-4857-4393-9562-d2ef34185924 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:52.978949 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5c7754bb-4857-4393-9562-d2ef34185924 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:52.979392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5c7754bb-4857-4393-9562-d2ef34185924 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:52.979811 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5c7754bb-4857-4393-9562-d2ef34185924 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:53.130639 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-5c7754bb-4857-4393-9562-d2ef34185924 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:53.140198 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-5c7754bb-4857-4393-9562-d2ef34185924 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:53.141817 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-5c7754bb-4857-4393-9562-d2ef34185924 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:53.142990 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-5c7754bb-4857-4393-9562-d2ef34185924 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1740 microversion: 2.20 time: 0.179856 Aug 28 10:19:53.143547 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 229/477] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:52 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:54.168650 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-426fd8b1-e893-4e9d-981f-035fbc952748 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:54.169295 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-426fd8b1-e893-4e9d-981f-035fbc952748 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:54.175574 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-426fd8b1-e893-4e9d-981f-035fbc952748 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:54.176049 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-426fd8b1-e893-4e9d-981f-035fbc952748 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:54.176469 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-426fd8b1-e893-4e9d-981f-035fbc952748 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:54.177165 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-426fd8b1-e893-4e9d-981f-035fbc952748 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:54.177818 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-426fd8b1-e893-4e9d-981f-035fbc952748 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:54.178419 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-426fd8b1-e893-4e9d-981f-035fbc952748 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:54.323913 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-426fd8b1-e893-4e9d-981f-035fbc952748 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:54.337609 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-426fd8b1-e893-4e9d-981f-035fbc952748 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:54.339290 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-426fd8b1-e893-4e9d-981f-035fbc952748 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:54.340529 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-426fd8b1-e893-4e9d-981f-035fbc952748 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1740 microversion: 2.20 time: 0.176302 Aug 28 10:19:54.343052 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 249/478] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:54 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:55.364484 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-2143c894-2c4d-41d7-b7b7-ac9e0da542d4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:55.365142 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-2143c894-2c4d-41d7-b7b7-ac9e0da542d4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:55.371840 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2143c894-2c4d-41d7-b7b7-ac9e0da542d4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:55.372560 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2143c894-2c4d-41d7-b7b7-ac9e0da542d4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:55.373161 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2143c894-2c4d-41d7-b7b7-ac9e0da542d4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:55.374046 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2143c894-2c4d-41d7-b7b7-ac9e0da542d4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:55.374682 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2143c894-2c4d-41d7-b7b7-ac9e0da542d4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:55.375098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2143c894-2c4d-41d7-b7b7-ac9e0da542d4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:55.535601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-2143c894-2c4d-41d7-b7b7-ac9e0da542d4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:55.545096 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-2143c894-2c4d-41d7-b7b7-ac9e0da542d4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:55.546528 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-2143c894-2c4d-41d7-b7b7-ac9e0da542d4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:55.547896 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-2143c894-2c4d-41d7-b7b7-ac9e0da542d4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1740 microversion: 2.20 time: 0.187422 Aug 28 10:19:55.548867 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 230/479] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:55 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:56.575054 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3e00f237-7413-48cd-8b06-4783057c0ff7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:56.575685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3e00f237-7413-48cd-8b06-4783057c0ff7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:56.583266 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3e00f237-7413-48cd-8b06-4783057c0ff7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:56.583824 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3e00f237-7413-48cd-8b06-4783057c0ff7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:56.584325 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3e00f237-7413-48cd-8b06-4783057c0ff7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:56.585180 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3e00f237-7413-48cd-8b06-4783057c0ff7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:56.585694 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3e00f237-7413-48cd-8b06-4783057c0ff7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:56.586177 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3e00f237-7413-48cd-8b06-4783057c0ff7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:56.718055 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3e00f237-7413-48cd-8b06-4783057c0ff7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:56.726678 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3e00f237-7413-48cd-8b06-4783057c0ff7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:56.728098 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3e00f237-7413-48cd-8b06-4783057c0ff7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:56.729429 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3e00f237-7413-48cd-8b06-4783057c0ff7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1740 microversion: 2.20 time: 0.160987 Aug 28 10:19:56.729991 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 250/480] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:56 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:57.754370 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-acf3f974-8ef0-4090-b5bb-18c90aa0538c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:57.755165 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-acf3f974-8ef0-4090-b5bb-18c90aa0538c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:57.763650 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-acf3f974-8ef0-4090-b5bb-18c90aa0538c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:57.764268 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-acf3f974-8ef0-4090-b5bb-18c90aa0538c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:57.764836 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-acf3f974-8ef0-4090-b5bb-18c90aa0538c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:57.765676 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-acf3f974-8ef0-4090-b5bb-18c90aa0538c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:57.766274 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-acf3f974-8ef0-4090-b5bb-18c90aa0538c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:57.766786 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-acf3f974-8ef0-4090-b5bb-18c90aa0538c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:57.904542 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-acf3f974-8ef0-4090-b5bb-18c90aa0538c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:57.913837 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-acf3f974-8ef0-4090-b5bb-18c90aa0538c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:57.915618 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-acf3f974-8ef0-4090-b5bb-18c90aa0538c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:57.917100 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-acf3f974-8ef0-4090-b5bb-18c90aa0538c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1740 microversion: 2.20 time: 0.167423 Aug 28 10:19:57.917657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 231/481] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:57 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:19:58.940766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-81fcc852-5d81-40cd-98b9-2896cd8af5f0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:19:58.941438 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-81fcc852-5d81-40cd-98b9-2896cd8af5f0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:19:58.947767 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81fcc852-5d81-40cd-98b9-2896cd8af5f0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:58.948243 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81fcc852-5d81-40cd-98b9-2896cd8af5f0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:58.948709 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81fcc852-5d81-40cd-98b9-2896cd8af5f0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:58.949388 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81fcc852-5d81-40cd-98b9-2896cd8af5f0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:19:58.949831 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81fcc852-5d81-40cd-98b9-2896cd8af5f0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:19:58.950243 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81fcc852-5d81-40cd-98b9-2896cd8af5f0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:19:59.085929 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-81fcc852-5d81-40cd-98b9-2896cd8af5f0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:59.094647 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-81fcc852-5d81-40cd-98b9-2896cd8af5f0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:59.096090 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-81fcc852-5d81-40cd-98b9-2896cd8af5f0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:19:59.097269 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-81fcc852-5d81-40cd-98b9-2896cd8af5f0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1722 microversion: 2.20 time: 0.160502 Aug 28 10:19:59.097827 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 251/482] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:19:58 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:00.124657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-94fdbe4f-b737-491a-8868-e710c7651e58 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:00.125457 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-94fdbe4f-b737-491a-8868-e710c7651e58 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:00.134211 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-94fdbe4f-b737-491a-8868-e710c7651e58 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:00.134848 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-94fdbe4f-b737-491a-8868-e710c7651e58 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:00.135416 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-94fdbe4f-b737-491a-8868-e710c7651e58 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:00.136397 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-94fdbe4f-b737-491a-8868-e710c7651e58 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:00.136962 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-94fdbe4f-b737-491a-8868-e710c7651e58 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:00.137518 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-94fdbe4f-b737-491a-8868-e710c7651e58 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:00.288039 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-94fdbe4f-b737-491a-8868-e710c7651e58 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:00.296645 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-94fdbe4f-b737-491a-8868-e710c7651e58 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:00.298069 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-94fdbe4f-b737-491a-8868-e710c7651e58 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:00.299205 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-94fdbe4f-b737-491a-8868-e710c7651e58 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1722 microversion: 2.20 time: 0.181052 Aug 28 10:20:00.299760 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 232/483] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:00 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:01.323464 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2c723bd7-3239-46a8-b70f-e993019a8a7b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:01.324203 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2c723bd7-3239-46a8-b70f-e993019a8a7b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:01.332084 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c723bd7-3239-46a8-b70f-e993019a8a7b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:01.332716 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c723bd7-3239-46a8-b70f-e993019a8a7b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:01.333272 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c723bd7-3239-46a8-b70f-e993019a8a7b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:01.334074 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c723bd7-3239-46a8-b70f-e993019a8a7b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:01.334621 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c723bd7-3239-46a8-b70f-e993019a8a7b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:01.335130 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c723bd7-3239-46a8-b70f-e993019a8a7b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:01.466616 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2c723bd7-3239-46a8-b70f-e993019a8a7b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:01.475189 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2c723bd7-3239-46a8-b70f-e993019a8a7b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:01.476633 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2c723bd7-3239-46a8-b70f-e993019a8a7b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:01.477771 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2c723bd7-3239-46a8-b70f-e993019a8a7b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1722 microversion: 2.20 time: 0.159215 Aug 28 10:20:01.478337 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 252/484] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:01 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:02.504871 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4885abdb-21fa-43f0-a6b1-5c2e011ecd45 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:02.505773 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4885abdb-21fa-43f0-a6b1-5c2e011ecd45 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:02.516206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4885abdb-21fa-43f0-a6b1-5c2e011ecd45 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:02.516716 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4885abdb-21fa-43f0-a6b1-5c2e011ecd45 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:02.517141 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4885abdb-21fa-43f0-a6b1-5c2e011ecd45 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:02.517812 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4885abdb-21fa-43f0-a6b1-5c2e011ecd45 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:02.518252 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4885abdb-21fa-43f0-a6b1-5c2e011ecd45 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:02.518664 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4885abdb-21fa-43f0-a6b1-5c2e011ecd45 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:02.653252 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4885abdb-21fa-43f0-a6b1-5c2e011ecd45 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:02.666404 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4885abdb-21fa-43f0-a6b1-5c2e011ecd45 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:02.668596 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4885abdb-21fa-43f0-a6b1-5c2e011ecd45 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:02.670414 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4885abdb-21fa-43f0-a6b1-5c2e011ecd45 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1722 microversion: 2.20 time: 0.171990 Aug 28 10:20:02.670973 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 233/485] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:02 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:03.204752 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-7383e2fa-451f-4f60-a510-9ab093f2f2c2 req-5ba2eaa2-59d3-4c7d-b764-80c87a0ad967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a0819fc-2347-457b-804f-7ef819596193", "name": "network-vif-unplugged", "status": "completed", "tag": "fe1c34ee-5586-4bd0-a9a5-7cc7349b7bd2"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:20:03.214252 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7383e2fa-451f-4f60-a510-9ab093f2f2c2 req-5ba2eaa2-59d3-4c7d-b764-80c87a0ad967 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:03.214723 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7383e2fa-451f-4f60-a510-9ab093f2f2c2 req-5ba2eaa2-59d3-4c7d-b764-80c87a0ad967 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:03.215139 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7383e2fa-451f-4f60-a510-9ab093f2f2c2 req-5ba2eaa2-59d3-4c7d-b764-80c87a0ad967 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:03.226375 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-7383e2fa-451f-4f60-a510-9ab093f2f2c2 req-5ba2eaa2-59d3-4c7d-b764-80c87a0ad967 service nova] Creating event network-vif-unplugged:fe1c34ee-5586-4bd0-a9a5-7cc7349b7bd2 for instance 2a0819fc-2347-457b-804f-7ef819596193 on hv-cinder-85200 Aug 28 10:20:03.231661 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-7383e2fa-451f-4f60-a510-9ab093f2f2c2 req-5ba2eaa2-59d3-4c7d-b764-80c87a0ad967 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030641 Aug 28 10:20:03.232232 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 253/486] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:20:03.692624 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-ca49db94-0631-46c8-8907-29f53a77094a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:03.693259 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-ca49db94-0631-46c8-8907-29f53a77094a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:03.700353 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ca49db94-0631-46c8-8907-29f53a77094a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:03.700868 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ca49db94-0631-46c8-8907-29f53a77094a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:03.701475 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ca49db94-0631-46c8-8907-29f53a77094a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:03.702172 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ca49db94-0631-46c8-8907-29f53a77094a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:03.702648 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ca49db94-0631-46c8-8907-29f53a77094a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:03.703102 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ca49db94-0631-46c8-8907-29f53a77094a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:03.837924 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-ca49db94-0631-46c8-8907-29f53a77094a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:03.846922 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-ca49db94-0631-46c8-8907-29f53a77094a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:03.848290 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-ca49db94-0631-46c8-8907-29f53a77094a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:03.849932 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-ca49db94-0631-46c8-8907-29f53a77094a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1722 microversion: 2.20 time: 0.161416 Aug 28 10:20:03.850498 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 234/487] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:03 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:04.161541 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6579084a-41d1-4bab-8c5b-8608629fa816 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-68966489", "imageRef": "2780c39b-8bd3-4e73-9669-2b2e29474f3e", "flavorRef": "452", "networks": [{"uuid": "ce8925b3-ae0f-47f4-a139-86fe56866f56"}]}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:20:04.214523 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-6579084a-41d1-4bab-8c5b-8608629fa816 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] validate_networks() for [('ce8925b3-ae0f-47f4-a139-86fe56866f56', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 28 10:20:04.563196 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-6579084a-41d1-4bab-8c5b-8608629fa816 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 28 10:20:04.563607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-6579084a-41d1-4bab-8c5b-8608629fa816 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 28 10:20:04.564070 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-6579084a-41d1-4bab-8c5b-8608629fa816 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 28 10:20:04.564492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-6579084a-41d1-4bab-8c5b-8608629fa816 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 28 10:20:04.564918 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-6579084a-41d1-4bab-8c5b-8608629fa816 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 28 10:20:04.574889 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6579084a-41d1-4bab-8c5b-8608629fa816 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:04.575364 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6579084a-41d1-4bab-8c5b-8608629fa816 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:04.575789 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6579084a-41d1-4bab-8c5b-8608629fa816 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:04.576524 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6579084a-41d1-4bab-8c5b-8608629fa816 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:04.576973 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6579084a-41d1-4bab-8c5b-8608629fa816 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:04.577387 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6579084a-41d1-4bab-8c5b-8608629fa816 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:04.594497 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-6579084a-41d1-4bab-8c5b-8608629fa816 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Getting quotas for project 04c4f12270d54d5784bb9a12aced18c2. Resources: {'instances', 'cores', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:20:04.598377 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-6579084a-41d1-4bab-8c5b-8608629fa816 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Getting quotas for user 538b5483267549e6be369a653928b4b9 and project 04c4f12270d54d5784bb9a12aced18c2. Resources: {'instances', 'cores', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:20:04.609417 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6579084a-41d1-4bab-8c5b-8608629fa816 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 28 10:20:04.611812 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6579084a-41d1-4bab-8c5b-8608629fa816 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2780c39b-8bd3-4e73-9669-2b2e29474f3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 28 10:20:04.656167 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6579084a-41d1-4bab-8c5b-8608629fa816 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498812 Aug 28 10:20:04.657043 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 254/488] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Aug 28 10:20:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 28 10:20:04.668326 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-0bb03c0a-abbb-4f63-bf0b-46969a066b2c tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:04.668983 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-0bb03c0a-abbb-4f63-bf0b-46969a066b2c tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:04.720612 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-0bb03c0a-abbb-4f63-bf0b-46969a066b2c tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:04.727700 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-0bb03c0a-abbb-4f63-bf0b-46969a066b2c tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1217 microversion: 2.1 time: 0.063688 Aug 28 10:20:04.728254 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 235/489] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:04 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1217 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:04.873151 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cdfbb55c-0d53-4b47-919b-488fa29858a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:04.873736 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cdfbb55c-0d53-4b47-919b-488fa29858a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:04.880268 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cdfbb55c-0d53-4b47-919b-488fa29858a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:04.880712 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cdfbb55c-0d53-4b47-919b-488fa29858a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:04.881133 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cdfbb55c-0d53-4b47-919b-488fa29858a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:04.881948 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cdfbb55c-0d53-4b47-919b-488fa29858a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:04.882322 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cdfbb55c-0d53-4b47-919b-488fa29858a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:04.882853 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cdfbb55c-0d53-4b47-919b-488fa29858a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:05.018121 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cdfbb55c-0d53-4b47-919b-488fa29858a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:05.030867 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cdfbb55c-0d53-4b47-919b-488fa29858a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:05.032527 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cdfbb55c-0d53-4b47-919b-488fa29858a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:05.033667 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cdfbb55c-0d53-4b47-919b-488fa29858a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1665 microversion: 2.20 time: 0.164628 Aug 28 10:20:05.034223 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 255/490] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:04 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1665 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:05.061891 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-fcbe5d5f-0364-46b9-8a18-56dcc35e4f50 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "250ad4af-2e69-4f8c-a1ba-ba6144fab292"}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:20:05.064670 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-fcbe5d5f-0364-46b9-8a18-56dcc35e4f50 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:05.071851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fcbe5d5f-0364-46b9-8a18-56dcc35e4f50 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:05.072328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fcbe5d5f-0364-46b9-8a18-56dcc35e4f50 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:05.072786 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fcbe5d5f-0364-46b9-8a18-56dcc35e4f50 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:05.073464 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fcbe5d5f-0364-46b9-8a18-56dcc35e4f50 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:05.073892 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fcbe5d5f-0364-46b9-8a18-56dcc35e4f50 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:05.074299 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fcbe5d5f-0364-46b9-8a18-56dcc35e4f50 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:05.379924 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-fcbe5d5f-0364-46b9-8a18-56dcc35e4f50 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "POST /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.326909 Aug 28 10:20:05.380720 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 236/491] 10.222.0.40 () {62 vars in 1364 bytes} [Sun Aug 28 10:20:05 2022] POST /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193/os-volume_attachments => generated 188 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 28 10:20:05.510089 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b932a5c2-c77f-470f-ac8f-74e1291aef1e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:20:05.510602 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b932a5c2-c77f-470f-ac8f-74e1291aef1e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:05.517138 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b932a5c2-c77f-470f-ac8f-74e1291aef1e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:05.517652 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b932a5c2-c77f-470f-ac8f-74e1291aef1e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:05.518105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b932a5c2-c77f-470f-ac8f-74e1291aef1e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:05.518803 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b932a5c2-c77f-470f-ac8f-74e1291aef1e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:05.519275 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b932a5c2-c77f-470f-ac8f-74e1291aef1e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:05.519686 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b932a5c2-c77f-470f-ac8f-74e1291aef1e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:05.562445 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b932a5c2-c77f-470f-ac8f-74e1291aef1e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120663) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 28 10:20:05.635035 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b932a5c2-c77f-470f-ac8f-74e1291aef1e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "POST /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193/action" status: 202 len: 0 microversion: 2.20 time: 0.128963 Aug 28 10:20:05.635764 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 256/492] 10.222.0.40 () {62 vars in 1319 bytes} [Sun Aug 28 10:20:05 2022] POST /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 28 10:20:05.644119 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-83168986-9074-43d7-bcf1-bfc2af05951e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:05.644831 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-83168986-9074-43d7-bcf1-bfc2af05951e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:05.650730 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-83168986-9074-43d7-bcf1-bfc2af05951e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:05.651211 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-83168986-9074-43d7-bcf1-bfc2af05951e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:05.651637 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-83168986-9074-43d7-bcf1-bfc2af05951e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:05.652324 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-83168986-9074-43d7-bcf1-bfc2af05951e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:05.652796 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-83168986-9074-43d7-bcf1-bfc2af05951e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:05.653213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-83168986-9074-43d7-bcf1-bfc2af05951e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:05.657229 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:20:05.748210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d61a2fb7-4d34-4cc4-ade3-aceffa32cb00 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:05.748821 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d61a2fb7-4d34-4cc4-ade3-aceffa32cb00 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:05.755294 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d61a2fb7-4d34-4cc4-ade3-aceffa32cb00 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:05.756049 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d61a2fb7-4d34-4cc4-ade3-aceffa32cb00 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:05.756451 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d61a2fb7-4d34-4cc4-ade3-aceffa32cb00 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:05.757392 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d61a2fb7-4d34-4cc4-ade3-aceffa32cb00 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:05.758118 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d61a2fb7-4d34-4cc4-ade3-aceffa32cb00 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:05.758523 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d61a2fb7-4d34-4cc4-ade3-aceffa32cb00 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:05.773848 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:20:05.794244 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-83168986-9074-43d7-bcf1-bfc2af05951e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:05.803599 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-83168986-9074-43d7-bcf1-bfc2af05951e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:05.805095 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-83168986-9074-43d7-bcf1-bfc2af05951e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:05.806252 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-83168986-9074-43d7-bcf1-bfc2af05951e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1751 microversion: 2.20 time: 0.166061 Aug 28 10:20:05.806810 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 237/493] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:05 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:05.828274 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d61a2fb7-4d34-4cc4-ade3-aceffa32cb00 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:05.835857 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d61a2fb7-4d34-4cc4-ade3-aceffa32cb00 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1269 microversion: 2.1 time: 0.091501 Aug 28 10:20:05.836459 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 257/494] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:05 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1269 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:20:06.835779 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-b26130b9-5680-4614-b9b9-d5a8b12ede87 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:06.836145 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-b26130b9-5680-4614-b9b9-d5a8b12ede87 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:06.843288 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b26130b9-5680-4614-b9b9-d5a8b12ede87 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:06.843916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b26130b9-5680-4614-b9b9-d5a8b12ede87 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:06.844405 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b26130b9-5680-4614-b9b9-d5a8b12ede87 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:06.845403 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b26130b9-5680-4614-b9b9-d5a8b12ede87 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:06.845911 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b26130b9-5680-4614-b9b9-d5a8b12ede87 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:06.846551 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b26130b9-5680-4614-b9b9-d5a8b12ede87 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:06.856029 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ac488003-20b4-4073-a2ff-bbb3326cd6b8 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:06.856760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ac488003-20b4-4073-a2ff-bbb3326cd6b8 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:06.863258 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ac488003-20b4-4073-a2ff-bbb3326cd6b8 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:06.863916 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ac488003-20b4-4073-a2ff-bbb3326cd6b8 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:06.864641 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ac488003-20b4-4073-a2ff-bbb3326cd6b8 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:06.865798 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ac488003-20b4-4073-a2ff-bbb3326cd6b8 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:06.866386 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ac488003-20b4-4073-a2ff-bbb3326cd6b8 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:06.866940 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ac488003-20b4-4073-a2ff-bbb3326cd6b8 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:07.078311 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-b26130b9-5680-4614-b9b9-d5a8b12ede87 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:07.081969 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ac488003-20b4-4073-a2ff-bbb3326cd6b8 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:07.088924 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-b26130b9-5680-4614-b9b9-d5a8b12ede87 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:07.090891 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-b26130b9-5680-4614-b9b9-d5a8b12ede87 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:07.091303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ac488003-20b4-4073-a2ff-bbb3326cd6b8 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1317 microversion: 2.1 time: 0.238460 Aug 28 10:20:07.092085 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 258/495] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:06 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:07.092541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-b26130b9-5680-4614-b9b9-d5a8b12ede87 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1751 microversion: 2.20 time: 0.263136 Aug 28 10:20:07.093264 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 238/496] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:06 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1751 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:07.226468 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-0aeebc16-268e-4d1c-893c-287022d71ff3 req-6569d2ee-4f85-4e27-88b4-4188756a12da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2395cb9a-a58f-4b70-ae5b-d6a8c50defd5", "tag": "91385417-fe64-4627-8e5b-26521bfffb9f"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:20:07.236465 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-0aeebc16-268e-4d1c-893c-287022d71ff3 req-6569d2ee-4f85-4e27-88b4-4188756a12da service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:07.237727 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-0aeebc16-268e-4d1c-893c-287022d71ff3 req-6569d2ee-4f85-4e27-88b4-4188756a12da service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:07.238149 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-0aeebc16-268e-4d1c-893c-287022d71ff3 req-6569d2ee-4f85-4e27-88b4-4188756a12da service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:07.251556 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-0aeebc16-268e-4d1c-893c-287022d71ff3 req-6569d2ee-4f85-4e27-88b4-4188756a12da service nova] Creating event network-changed:91385417-fe64-4627-8e5b-26521bfffb9f for instance 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 on hv-cinder-85200 Aug 28 10:20:07.256562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-0aeebc16-268e-4d1c-893c-287022d71ff3 req-6569d2ee-4f85-4e27-88b4-4188756a12da service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033922 Aug 28 10:20:07.257165 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 259/497] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:20:08.116572 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-3abd9142-8b16-44bb-92c8-97be6d9b6281 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:08.117268 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-3abd9142-8b16-44bb-92c8-97be6d9b6281 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:08.118145 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6b7a958e-4756-413f-8c13-665bd2e541a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:08.118838 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6b7a958e-4756-413f-8c13-665bd2e541a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:08.125302 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3abd9142-8b16-44bb-92c8-97be6d9b6281 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:08.125784 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3abd9142-8b16-44bb-92c8-97be6d9b6281 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:08.126193 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3abd9142-8b16-44bb-92c8-97be6d9b6281 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:08.126298 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6b7a958e-4756-413f-8c13-665bd2e541a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:08.126782 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6b7a958e-4756-413f-8c13-665bd2e541a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:08.126879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3abd9142-8b16-44bb-92c8-97be6d9b6281 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:08.127207 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6b7a958e-4756-413f-8c13-665bd2e541a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:08.127314 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3abd9142-8b16-44bb-92c8-97be6d9b6281 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:08.127710 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3abd9142-8b16-44bb-92c8-97be6d9b6281 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:08.127919 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6b7a958e-4756-413f-8c13-665bd2e541a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:08.128357 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6b7a958e-4756-413f-8c13-665bd2e541a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:08.128800 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6b7a958e-4756-413f-8c13-665bd2e541a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:08.321694 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6b7a958e-4756-413f-8c13-665bd2e541a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:08.325839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-3abd9142-8b16-44bb-92c8-97be6d9b6281 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:08.332321 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6b7a958e-4756-413f-8c13-665bd2e541a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:08.333980 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6b7a958e-4756-413f-8c13-665bd2e541a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:08.334259 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-3abd9142-8b16-44bb-92c8-97be6d9b6281 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1317 microversion: 2.1 time: 0.223607 Aug 28 10:20:08.334838 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 239/498] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:08 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:08.335319 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6b7a958e-4756-413f-8c13-665bd2e541a0 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1753 microversion: 2.20 time: 0.222903 Aug 28 10:20:08.335969 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 260/499] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:08 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1753 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:09.358555 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-3aba3a3b-599e-4824-b8a8-62933548b6b1 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:09.359612 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-3aba3a3b-599e-4824-b8a8-62933548b6b1 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:09.360800 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-73714ac4-9c12-41a1-bb9c-e712b28fe1a1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:09.361394 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-73714ac4-9c12-41a1-bb9c-e712b28fe1a1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:09.366534 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3aba3a3b-599e-4824-b8a8-62933548b6b1 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:09.366993 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3aba3a3b-599e-4824-b8a8-62933548b6b1 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:09.367417 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3aba3a3b-599e-4824-b8a8-62933548b6b1 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:09.367535 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-73714ac4-9c12-41a1-bb9c-e712b28fe1a1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:09.367945 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-73714ac4-9c12-41a1-bb9c-e712b28fe1a1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:09.368072 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3aba3a3b-599e-4824-b8a8-62933548b6b1 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:09.368369 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-73714ac4-9c12-41a1-bb9c-e712b28fe1a1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:09.368532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3aba3a3b-599e-4824-b8a8-62933548b6b1 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:09.368965 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3aba3a3b-599e-4824-b8a8-62933548b6b1 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:09.369065 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-73714ac4-9c12-41a1-bb9c-e712b28fe1a1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:09.369499 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-73714ac4-9c12-41a1-bb9c-e712b28fe1a1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:09.369905 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-73714ac4-9c12-41a1-bb9c-e712b28fe1a1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:09.558865 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-73714ac4-9c12-41a1-bb9c-e712b28fe1a1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:09.562093 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-3aba3a3b-599e-4824-b8a8-62933548b6b1 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:09.567778 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-73714ac4-9c12-41a1-bb9c-e712b28fe1a1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:09.569234 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-73714ac4-9c12-41a1-bb9c-e712b28fe1a1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:09.570369 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-73714ac4-9c12-41a1-bb9c-e712b28fe1a1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1753 microversion: 2.20 time: 0.215213 Aug 28 10:20:09.570529 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-3aba3a3b-599e-4824-b8a8-62933548b6b1 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1317 microversion: 2.1 time: 0.218373 Aug 28 10:20:09.571187 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 261/500] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:09 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1753 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:09.571346 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 240/501] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:09 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:10.597786 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7d564604-df6f-4bb5-9a49-c89e39de2f23 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:10.598918 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7d564604-df6f-4bb5-9a49-c89e39de2f23 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:10.599323 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-70e53a84-df65-440d-8c3b-93a14b008adf tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:10.600331 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-70e53a84-df65-440d-8c3b-93a14b008adf tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:10.609680 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d564604-df6f-4bb5-9a49-c89e39de2f23 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:10.610185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d564604-df6f-4bb5-9a49-c89e39de2f23 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:10.610530 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-70e53a84-df65-440d-8c3b-93a14b008adf tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:10.610661 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d564604-df6f-4bb5-9a49-c89e39de2f23 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:10.611010 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-70e53a84-df65-440d-8c3b-93a14b008adf tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:10.611274 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d564604-df6f-4bb5-9a49-c89e39de2f23 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:10.611414 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-70e53a84-df65-440d-8c3b-93a14b008adf tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:10.611734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d564604-df6f-4bb5-9a49-c89e39de2f23 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:10.612096 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-70e53a84-df65-440d-8c3b-93a14b008adf tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:10.612269 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d564604-df6f-4bb5-9a49-c89e39de2f23 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:10.612571 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-70e53a84-df65-440d-8c3b-93a14b008adf tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:10.612994 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-70e53a84-df65-440d-8c3b-93a14b008adf tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:10.806325 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7d564604-df6f-4bb5-9a49-c89e39de2f23 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:10.811498 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-70e53a84-df65-440d-8c3b-93a14b008adf tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:10.817654 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7d564604-df6f-4bb5-9a49-c89e39de2f23 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1317 microversion: 2.1 time: 0.226615 Aug 28 10:20:10.818643 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 262/502] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:10 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:10.822760 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-70e53a84-df65-440d-8c3b-93a14b008adf tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:10.824190 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-70e53a84-df65-440d-8c3b-93a14b008adf tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:10.825399 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-70e53a84-df65-440d-8c3b-93a14b008adf tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1753 microversion: 2.20 time: 0.232757 Aug 28 10:20:10.825883 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 241/503] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:10 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1753 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:11.843140 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d21e5fba-80d7-46f7-9507-e63043e3cc38 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:11.844119 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d21e5fba-80d7-46f7-9507-e63043e3cc38 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:11.849457 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-b432872e-080c-4f54-a0af-8885913dea91 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:11.850092 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-b432872e-080c-4f54-a0af-8885913dea91 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:11.850814 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d21e5fba-80d7-46f7-9507-e63043e3cc38 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:11.851320 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d21e5fba-80d7-46f7-9507-e63043e3cc38 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:11.851768 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d21e5fba-80d7-46f7-9507-e63043e3cc38 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:11.852489 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d21e5fba-80d7-46f7-9507-e63043e3cc38 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:11.852988 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d21e5fba-80d7-46f7-9507-e63043e3cc38 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:11.853423 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d21e5fba-80d7-46f7-9507-e63043e3cc38 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:11.857309 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b432872e-080c-4f54-a0af-8885913dea91 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:11.857805 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b432872e-080c-4f54-a0af-8885913dea91 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:11.858254 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b432872e-080c-4f54-a0af-8885913dea91 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:11.858976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b432872e-080c-4f54-a0af-8885913dea91 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:11.859526 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b432872e-080c-4f54-a0af-8885913dea91 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:11.859969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b432872e-080c-4f54-a0af-8885913dea91 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:12.048759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d21e5fba-80d7-46f7-9507-e63043e3cc38 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:12.050011 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-b432872e-080c-4f54-a0af-8885913dea91 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:12.057634 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d21e5fba-80d7-46f7-9507-e63043e3cc38 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1317 microversion: 2.1 time: 0.221553 Aug 28 10:20:12.058812 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 263/504] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:11 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:12.066872 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-b432872e-080c-4f54-a0af-8885913dea91 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:12.068413 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-b432872e-080c-4f54-a0af-8885913dea91 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:12.069706 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-b432872e-080c-4f54-a0af-8885913dea91 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.224449 Aug 28 10:20:12.070328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 242/505] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:11 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:13.080441 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-59b5deb7-ed82-40de-8954-28b491971ca4 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:13.081074 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-59b5deb7-ed82-40de-8954-28b491971ca4 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:13.087309 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-59b5deb7-ed82-40de-8954-28b491971ca4 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:13.088073 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-59b5deb7-ed82-40de-8954-28b491971ca4 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:13.088730 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-59b5deb7-ed82-40de-8954-28b491971ca4 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:13.089727 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-59b5deb7-ed82-40de-8954-28b491971ca4 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:13.090263 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-59b5deb7-ed82-40de-8954-28b491971ca4 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:13.090682 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-59b5deb7-ed82-40de-8954-28b491971ca4 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:13.093121 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-32a48431-d60f-4cb2-8631-9b13ce19b751 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:13.093723 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-32a48431-d60f-4cb2-8631-9b13ce19b751 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:13.100442 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-32a48431-d60f-4cb2-8631-9b13ce19b751 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:13.100944 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-32a48431-d60f-4cb2-8631-9b13ce19b751 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:13.101364 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-32a48431-d60f-4cb2-8631-9b13ce19b751 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:13.102048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-32a48431-d60f-4cb2-8631-9b13ce19b751 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:13.102483 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-32a48431-d60f-4cb2-8631-9b13ce19b751 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:13.102894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-32a48431-d60f-4cb2-8631-9b13ce19b751 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:13.297668 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-59b5deb7-ed82-40de-8954-28b491971ca4 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:13.309332 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-59b5deb7-ed82-40de-8954-28b491971ca4 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1317 microversion: 2.1 time: 0.233699 Aug 28 10:20:13.310780 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 264/506] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:13 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:13.322991 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-32a48431-d60f-4cb2-8631-9b13ce19b751 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:13.334457 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-32a48431-d60f-4cb2-8631-9b13ce19b751 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:13.335906 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-32a48431-d60f-4cb2-8631-9b13ce19b751 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:13.337107 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-32a48431-d60f-4cb2-8631-9b13ce19b751 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.248013 Aug 28 10:20:13.348744 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 243/507] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:13 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:13.462062 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-07371eb4-812d-408f-a822-35945cc47f2e req-2e9442b3-5b84-4742-99ee-95ae4f34ecfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2395cb9a-a58f-4b70-ae5b-d6a8c50defd5", "name": "network-vif-plugged", "status": "completed", "tag": "91385417-fe64-4627-8e5b-26521bfffb9f"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:20:13.489272 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-07371eb4-812d-408f-a822-35945cc47f2e req-2e9442b3-5b84-4742-99ee-95ae4f34ecfd service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:13.489772 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-07371eb4-812d-408f-a822-35945cc47f2e req-2e9442b3-5b84-4742-99ee-95ae4f34ecfd service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:13.490192 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-07371eb4-812d-408f-a822-35945cc47f2e req-2e9442b3-5b84-4742-99ee-95ae4f34ecfd service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:13.522307 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-07371eb4-812d-408f-a822-35945cc47f2e req-2e9442b3-5b84-4742-99ee-95ae4f34ecfd service nova] Creating event network-vif-plugged:91385417-fe64-4627-8e5b-26521bfffb9f for instance 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 on hv-cinder-85200 Aug 28 10:20:13.533965 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-07371eb4-812d-408f-a822-35945cc47f2e req-2e9442b3-5b84-4742-99ee-95ae4f34ecfd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077467 Aug 28 10:20:13.534581 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 265/508] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:20:14.337938 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4645d8ae-3e1b-46b2-ab08-d6273af11f31 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:14.338936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4645d8ae-3e1b-46b2-ab08-d6273af11f31 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:14.342608 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=52 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:20:14.351303 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4645d8ae-3e1b-46b2-ab08-d6273af11f31 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:14.352085 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4645d8ae-3e1b-46b2-ab08-d6273af11f31 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:14.352883 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4645d8ae-3e1b-46b2-ab08-d6273af11f31 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:14.354004 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4645d8ae-3e1b-46b2-ab08-d6273af11f31 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:14.354730 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4645d8ae-3e1b-46b2-ab08-d6273af11f31 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:14.355385 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4645d8ae-3e1b-46b2-ab08-d6273af11f31 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:14.365921 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bb7abea4-65fc-4bd8-8129-41857cdef7b8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:14.366607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bb7abea4-65fc-4bd8-8129-41857cdef7b8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:14.373083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb7abea4-65fc-4bd8-8129-41857cdef7b8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:14.373559 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb7abea4-65fc-4bd8-8129-41857cdef7b8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:14.373981 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb7abea4-65fc-4bd8-8129-41857cdef7b8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:14.374659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb7abea4-65fc-4bd8-8129-41857cdef7b8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:14.375100 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb7abea4-65fc-4bd8-8129-41857cdef7b8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:14.375511 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb7abea4-65fc-4bd8-8129-41857cdef7b8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:14.556093 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4645d8ae-3e1b-46b2-ab08-d6273af11f31 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:14.576336 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4645d8ae-3e1b-46b2-ab08-d6273af11f31 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1317 microversion: 2.1 time: 0.244820 Aug 28 10:20:14.584953 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bb7abea4-65fc-4bd8-8129-41857cdef7b8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:14.593606 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:20:14.610304 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 244/509] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:14 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:14.610641 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bb7abea4-65fc-4bd8-8129-41857cdef7b8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:14.610641 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bb7abea4-65fc-4bd8-8129-41857cdef7b8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:14.610641 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bb7abea4-65fc-4bd8-8129-41857cdef7b8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.244895 Aug 28 10:20:14.610943 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 266/510] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:14 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:15.618175 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c6353f91-a7d8-41ae-a5b6-b7636d54e867 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:15.618841 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c6353f91-a7d8-41ae-a5b6-b7636d54e867 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:15.620744 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=2 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:20:15.631807 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dcbf899f-ff64-47f9-b1fa-0dd84789a846 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:15.632410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-dcbf899f-ff64-47f9-b1fa-0dd84789a846 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:15.632805 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c6353f91-a7d8-41ae-a5b6-b7636d54e867 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:15.633362 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c6353f91-a7d8-41ae-a5b6-b7636d54e867 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:15.633798 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c6353f91-a7d8-41ae-a5b6-b7636d54e867 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:15.634282 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=6 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:20:15.634557 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c6353f91-a7d8-41ae-a5b6-b7636d54e867 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:15.635010 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c6353f91-a7d8-41ae-a5b6-b7636d54e867 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:15.635485 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c6353f91-a7d8-41ae-a5b6-b7636d54e867 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:15.639992 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dcbf899f-ff64-47f9-b1fa-0dd84789a846 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:15.640476 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dcbf899f-ff64-47f9-b1fa-0dd84789a846 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:15.640929 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dcbf899f-ff64-47f9-b1fa-0dd84789a846 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:15.641837 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dcbf899f-ff64-47f9-b1fa-0dd84789a846 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:15.642469 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dcbf899f-ff64-47f9-b1fa-0dd84789a846 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:15.642888 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dcbf899f-ff64-47f9-b1fa-0dd84789a846 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:15.840314 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dcbf899f-ff64-47f9-b1fa-0dd84789a846 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:15.842763 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c6353f91-a7d8-41ae-a5b6-b7636d54e867 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:15.853858 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c6353f91-a7d8-41ae-a5b6-b7636d54e867 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1317 microversion: 2.1 time: 0.239006 Aug 28 10:20:15.854938 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 245/511] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:15 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:15.866816 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dcbf899f-ff64-47f9-b1fa-0dd84789a846 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:15.869393 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dcbf899f-ff64-47f9-b1fa-0dd84789a846 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:15.870779 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-dcbf899f-ff64-47f9-b1fa-0dd84789a846 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.243233 Aug 28 10:20:15.871821 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 267/512] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:15 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:16.879632 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8e4747ff-717e-4bc3-98aa-fdcbfcb7576d tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:16.880391 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-8e4747ff-717e-4bc3-98aa-fdcbfcb7576d tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:16.889350 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e4747ff-717e-4bc3-98aa-fdcbfcb7576d tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:16.889984 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e4747ff-717e-4bc3-98aa-fdcbfcb7576d tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:16.890558 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e4747ff-717e-4bc3-98aa-fdcbfcb7576d tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:16.891579 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e4747ff-717e-4bc3-98aa-fdcbfcb7576d tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:16.892301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e4747ff-717e-4bc3-98aa-fdcbfcb7576d tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:16.892727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e4747ff-717e-4bc3-98aa-fdcbfcb7576d tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:16.895186 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8376387a-3658-41b7-bbe2-617965d5c5c9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:16.895780 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8376387a-3658-41b7-bbe2-617965d5c5c9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:16.902220 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8376387a-3658-41b7-bbe2-617965d5c5c9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:16.902688 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8376387a-3658-41b7-bbe2-617965d5c5c9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:16.903371 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8376387a-3658-41b7-bbe2-617965d5c5c9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:16.904047 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8376387a-3658-41b7-bbe2-617965d5c5c9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:16.904484 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8376387a-3658-41b7-bbe2-617965d5c5c9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:16.904922 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8376387a-3658-41b7-bbe2-617965d5c5c9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:17.095161 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8376387a-3658-41b7-bbe2-617965d5c5c9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:17.098215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8e4747ff-717e-4bc3-98aa-fdcbfcb7576d tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:17.105121 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8376387a-3658-41b7-bbe2-617965d5c5c9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:17.105851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-8e4747ff-717e-4bc3-98aa-fdcbfcb7576d tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1317 microversion: 2.1 time: 0.231418 Aug 28 10:20:17.106646 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 246/513] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:16 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:17.106765 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8376387a-3658-41b7-bbe2-617965d5c5c9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:17.116723 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8376387a-3658-41b7-bbe2-617965d5c5c9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.225906 Aug 28 10:20:17.117669 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 268/514] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:16 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:18.130818 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-973409a8-4bd2-4cf4-a197-fbe8a001836f tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:18.131904 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-973409a8-4bd2-4cf4-a197-fbe8a001836f tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:18.144134 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a7099329-cff5-434d-a60d-294283f8cfcc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:18.144816 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-973409a8-4bd2-4cf4-a197-fbe8a001836f tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:18.145491 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-973409a8-4bd2-4cf4-a197-fbe8a001836f tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:18.145991 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-973409a8-4bd2-4cf4-a197-fbe8a001836f tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:18.146370 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a7099329-cff5-434d-a60d-294283f8cfcc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:18.147243 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-973409a8-4bd2-4cf4-a197-fbe8a001836f tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:18.147927 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-973409a8-4bd2-4cf4-a197-fbe8a001836f tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:18.148391 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-973409a8-4bd2-4cf4-a197-fbe8a001836f tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:18.154849 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a7099329-cff5-434d-a60d-294283f8cfcc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:18.155442 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a7099329-cff5-434d-a60d-294283f8cfcc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:18.155902 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a7099329-cff5-434d-a60d-294283f8cfcc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:18.156964 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a7099329-cff5-434d-a60d-294283f8cfcc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:18.157409 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a7099329-cff5-434d-a60d-294283f8cfcc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:18.157823 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a7099329-cff5-434d-a60d-294283f8cfcc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:18.354272 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-973409a8-4bd2-4cf4-a197-fbe8a001836f tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:18.357298 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a7099329-cff5-434d-a60d-294283f8cfcc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:18.362200 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-973409a8-4bd2-4cf4-a197-fbe8a001836f tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1317 microversion: 2.1 time: 0.237948 Aug 28 10:20:18.362842 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 247/515] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:18 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:18.366663 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a7099329-cff5-434d-a60d-294283f8cfcc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:18.368088 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a7099329-cff5-434d-a60d-294283f8cfcc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:18.369259 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a7099329-cff5-434d-a60d-294283f8cfcc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.232447 Aug 28 10:20:18.369843 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 269/516] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:18 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:19.384960 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-7921f6fa-da85-419e-82c4-04803e310b14 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:19.385779 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-7921f6fa-da85-419e-82c4-04803e310b14 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:19.393932 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-326fa8bb-b20b-4100-b45f-fff4949a053d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:19.394618 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7921f6fa-da85-419e-82c4-04803e310b14 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:19.394734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-326fa8bb-b20b-4100-b45f-fff4949a053d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:19.394885 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7921f6fa-da85-419e-82c4-04803e310b14 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:19.395275 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7921f6fa-da85-419e-82c4-04803e310b14 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:19.396134 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7921f6fa-da85-419e-82c4-04803e310b14 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:19.396745 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7921f6fa-da85-419e-82c4-04803e310b14 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:19.397031 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:20:19.397217 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7921f6fa-da85-419e-82c4-04803e310b14 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:19.404154 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-326fa8bb-b20b-4100-b45f-fff4949a053d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:19.404810 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-326fa8bb-b20b-4100-b45f-fff4949a053d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:19.405299 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-326fa8bb-b20b-4100-b45f-fff4949a053d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:19.406209 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-326fa8bb-b20b-4100-b45f-fff4949a053d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:19.406763 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-326fa8bb-b20b-4100-b45f-fff4949a053d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:19.407280 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-326fa8bb-b20b-4100-b45f-fff4949a053d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:19.618326 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7921f6fa-da85-419e-82c4-04803e310b14 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:19.625775 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-326fa8bb-b20b-4100-b45f-fff4949a053d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:19.626739 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-7921f6fa-da85-419e-82c4-04803e310b14 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1317 microversion: 2.1 time: 0.246718 Aug 28 10:20:19.627319 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 248/517] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:19 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:19.634671 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-326fa8bb-b20b-4100-b45f-fff4949a053d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:19.636101 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-326fa8bb-b20b-4100-b45f-fff4949a053d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:19.637282 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-326fa8bb-b20b-4100-b45f-fff4949a053d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.248252 Aug 28 10:20:19.637856 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 270/518] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:19 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:20.652195 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f2769e75-5ecf-417c-96fa-e009e1912490 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:20.661551 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4110ba8f-84b2-4421-bad2-503823b0b119 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:20.662237 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4110ba8f-84b2-4421-bad2-503823b0b119 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:20.665992 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f2769e75-5ecf-417c-96fa-e009e1912490 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:20.673381 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4110ba8f-84b2-4421-bad2-503823b0b119 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:20.675946 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4110ba8f-84b2-4421-bad2-503823b0b119 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:20.676477 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4110ba8f-84b2-4421-bad2-503823b0b119 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:20.677310 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4110ba8f-84b2-4421-bad2-503823b0b119 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:20.678765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f2769e75-5ecf-417c-96fa-e009e1912490 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:20.679331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4110ba8f-84b2-4421-bad2-503823b0b119 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:20.679822 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4110ba8f-84b2-4421-bad2-503823b0b119 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:20.680352 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f2769e75-5ecf-417c-96fa-e009e1912490 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:20.681809 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f2769e75-5ecf-417c-96fa-e009e1912490 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:20.682553 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f2769e75-5ecf-417c-96fa-e009e1912490 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:20.682960 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f2769e75-5ecf-417c-96fa-e009e1912490 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:20.685005 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f2769e75-5ecf-417c-96fa-e009e1912490 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:20.885831 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f2769e75-5ecf-417c-96fa-e009e1912490 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:20.892859 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4110ba8f-84b2-4421-bad2-503823b0b119 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:20.894100 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f2769e75-5ecf-417c-96fa-e009e1912490 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1317 microversion: 2.1 time: 0.248514 Aug 28 10:20:20.894792 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 249/519] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:20 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:20.901678 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4110ba8f-84b2-4421-bad2-503823b0b119 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:20.903093 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4110ba8f-84b2-4421-bad2-503823b0b119 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:20.904232 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4110ba8f-84b2-4421-bad2-503823b0b119 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.247639 Aug 28 10:20:20.904834 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 271/520] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:20 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:21.916770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-9b04df46-141b-4e14-b2d3-798b7c9951e6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:21.917633 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-9b04df46-141b-4e14-b2d3-798b7c9951e6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:21.927200 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9b04df46-141b-4e14-b2d3-798b7c9951e6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:21.927772 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9b04df46-141b-4e14-b2d3-798b7c9951e6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:21.928268 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9b04df46-141b-4e14-b2d3-798b7c9951e6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:21.929079 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9b04df46-141b-4e14-b2d3-798b7c9951e6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:21.929720 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9b04df46-141b-4e14-b2d3-798b7c9951e6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:21.930208 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9b04df46-141b-4e14-b2d3-798b7c9951e6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:21.930755 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c649196a-45f6-4abc-b4c7-bab451cdcb1e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:21.932056 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c649196a-45f6-4abc-b4c7-bab451cdcb1e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:21.943009 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c649196a-45f6-4abc-b4c7-bab451cdcb1e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:21.944930 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c649196a-45f6-4abc-b4c7-bab451cdcb1e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:21.945578 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c649196a-45f6-4abc-b4c7-bab451cdcb1e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:21.947298 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c649196a-45f6-4abc-b4c7-bab451cdcb1e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:21.948493 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c649196a-45f6-4abc-b4c7-bab451cdcb1e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:21.950457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c649196a-45f6-4abc-b4c7-bab451cdcb1e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:22.130598 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-9b04df46-141b-4e14-b2d3-798b7c9951e6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:22.139683 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-9b04df46-141b-4e14-b2d3-798b7c9951e6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1317 microversion: 2.1 time: 0.228558 Aug 28 10:20:22.140681 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 250/521] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:21 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:22.161916 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c649196a-45f6-4abc-b4c7-bab451cdcb1e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:22.179655 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c649196a-45f6-4abc-b4c7-bab451cdcb1e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:22.181039 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c649196a-45f6-4abc-b4c7-bab451cdcb1e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:22.182435 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c649196a-45f6-4abc-b4c7-bab451cdcb1e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.258348 Aug 28 10:20:22.183160 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 272/522] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:21 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:23.182071 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-62ccd9fb-bdb8-4ff2-afeb-f81559c27f31 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:23.182709 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-62ccd9fb-bdb8-4ff2-afeb-f81559c27f31 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:23.189752 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-62ccd9fb-bdb8-4ff2-afeb-f81559c27f31 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:23.190856 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-62ccd9fb-bdb8-4ff2-afeb-f81559c27f31 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:23.191366 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-62ccd9fb-bdb8-4ff2-afeb-f81559c27f31 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:23.192075 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-62ccd9fb-bdb8-4ff2-afeb-f81559c27f31 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:23.192552 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-62ccd9fb-bdb8-4ff2-afeb-f81559c27f31 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:23.193214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-62ccd9fb-bdb8-4ff2-afeb-f81559c27f31 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:23.211357 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-257eaf40-14ea-4906-8ab3-c09367e724d1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:23.211962 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-257eaf40-14ea-4906-8ab3-c09367e724d1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:23.218084 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-257eaf40-14ea-4906-8ab3-c09367e724d1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:23.218554 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-257eaf40-14ea-4906-8ab3-c09367e724d1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:23.219004 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-257eaf40-14ea-4906-8ab3-c09367e724d1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:23.219681 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-257eaf40-14ea-4906-8ab3-c09367e724d1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:23.220118 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-257eaf40-14ea-4906-8ab3-c09367e724d1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:23.220556 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-257eaf40-14ea-4906-8ab3-c09367e724d1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:23.397343 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-62ccd9fb-bdb8-4ff2-afeb-f81559c27f31 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:23.400278 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-257eaf40-14ea-4906-8ab3-c09367e724d1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:23.405218 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-62ccd9fb-bdb8-4ff2-afeb-f81559c27f31 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1317 microversion: 2.1 time: 0.228761 Aug 28 10:20:23.405798 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 251/523] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:23 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:23.412545 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-257eaf40-14ea-4906-8ab3-c09367e724d1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:23.414090 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-257eaf40-14ea-4906-8ab3-c09367e724d1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:23.416215 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-257eaf40-14ea-4906-8ab3-c09367e724d1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.214376 Aug 28 10:20:23.416768 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 273/524] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:23 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:24.429725 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-cea3b631-15a7-4a97-95b0-c5c84b9a17a1 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:24.430534 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-cea3b631-15a7-4a97-95b0-c5c84b9a17a1 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:24.440094 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cea3b631-15a7-4a97-95b0-c5c84b9a17a1 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:24.440858 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cea3b631-15a7-4a97-95b0-c5c84b9a17a1 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:24.441519 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cea3b631-15a7-4a97-95b0-c5c84b9a17a1 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:24.441833 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0dd4344f-ed79-4625-86d0-1a6511d19700 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:24.442284 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cea3b631-15a7-4a97-95b0-c5c84b9a17a1 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:24.442568 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0dd4344f-ed79-4625-86d0-1a6511d19700 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:24.442683 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cea3b631-15a7-4a97-95b0-c5c84b9a17a1 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:24.443036 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cea3b631-15a7-4a97-95b0-c5c84b9a17a1 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:24.448958 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dd4344f-ed79-4625-86d0-1a6511d19700 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:24.449440 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dd4344f-ed79-4625-86d0-1a6511d19700 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:24.449854 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dd4344f-ed79-4625-86d0-1a6511d19700 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:24.450559 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dd4344f-ed79-4625-86d0-1a6511d19700 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:24.451006 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dd4344f-ed79-4625-86d0-1a6511d19700 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:24.451423 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dd4344f-ed79-4625-86d0-1a6511d19700 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:24.639846 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-cea3b631-15a7-4a97-95b0-c5c84b9a17a1 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:24.644281 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0dd4344f-ed79-4625-86d0-1a6511d19700 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:24.649573 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-cea3b631-15a7-4a97-95b0-c5c84b9a17a1 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1317 microversion: 2.1 time: 0.225808 Aug 28 10:20:24.663157 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 252/525] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:24 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:24.666763 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0dd4344f-ed79-4625-86d0-1a6511d19700 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:24.668198 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0dd4344f-ed79-4625-86d0-1a6511d19700 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:24.669401 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0dd4344f-ed79-4625-86d0-1a6511d19700 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.233385 Aug 28 10:20:24.669966 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 274/526] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:24 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:25.670112 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-cd0e1448-d3f2-445e-b55c-d6b9805b9cea tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:25.670763 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-cd0e1448-d3f2-445e-b55c-d6b9805b9cea tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:25.679554 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cd0e1448-d3f2-445e-b55c-d6b9805b9cea tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:25.680049 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cd0e1448-d3f2-445e-b55c-d6b9805b9cea tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:25.680483 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cd0e1448-d3f2-445e-b55c-d6b9805b9cea tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:25.681315 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cd0e1448-d3f2-445e-b55c-d6b9805b9cea tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:25.681795 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cd0e1448-d3f2-445e-b55c-d6b9805b9cea tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:25.682213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cd0e1448-d3f2-445e-b55c-d6b9805b9cea tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:25.692635 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f69627f6-7547-4271-888e-1fdfab842b8b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:25.693947 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f69627f6-7547-4271-888e-1fdfab842b8b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:25.700751 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f69627f6-7547-4271-888e-1fdfab842b8b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:25.701533 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f69627f6-7547-4271-888e-1fdfab842b8b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:25.701959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f69627f6-7547-4271-888e-1fdfab842b8b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:25.702643 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f69627f6-7547-4271-888e-1fdfab842b8b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:25.703079 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f69627f6-7547-4271-888e-1fdfab842b8b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:25.703524 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f69627f6-7547-4271-888e-1fdfab842b8b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:25.719625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:20:25.857278 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-cd0e1448-d3f2-445e-b55c-d6b9805b9cea tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:25.860309 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=100 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:20:25.873034 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-cd0e1448-d3f2-445e-b55c-d6b9805b9cea tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1317 microversion: 2.1 time: 0.206537 Aug 28 10:20:25.885962 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 253/527] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:25 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:20:25.921320 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f69627f6-7547-4271-888e-1fdfab842b8b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:25.930923 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f69627f6-7547-4271-888e-1fdfab842b8b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:25.932631 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f69627f6-7547-4271-888e-1fdfab842b8b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:25.933797 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f69627f6-7547-4271-888e-1fdfab842b8b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.245121 Aug 28 10:20:25.934735 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 275/528] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:25 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 28 10:20:26.897857 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e16b704e-4d5f-46e8-8ce3-b33670094436 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:26.898861 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e16b704e-4d5f-46e8-8ce3-b33670094436 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:26.910458 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e16b704e-4d5f-46e8-8ce3-b33670094436 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:26.911252 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e16b704e-4d5f-46e8-8ce3-b33670094436 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:26.911865 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e16b704e-4d5f-46e8-8ce3-b33670094436 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:26.912557 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e16b704e-4d5f-46e8-8ce3-b33670094436 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:26.913015 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e16b704e-4d5f-46e8-8ce3-b33670094436 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:26.913428 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e16b704e-4d5f-46e8-8ce3-b33670094436 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:26.956856 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bb10a213-7297-4d03-8ec7-8069978758c7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:26.957556 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bb10a213-7297-4d03-8ec7-8069978758c7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:26.964600 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb10a213-7297-4d03-8ec7-8069978758c7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:26.965179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb10a213-7297-4d03-8ec7-8069978758c7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:26.965684 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb10a213-7297-4d03-8ec7-8069978758c7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:26.966630 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb10a213-7297-4d03-8ec7-8069978758c7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:26.967148 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb10a213-7297-4d03-8ec7-8069978758c7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:26.967691 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb10a213-7297-4d03-8ec7-8069978758c7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:27.137176 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-e16b704e-4d5f-46e8-8ce3-b33670094436 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:27.144835 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bb10a213-7297-4d03-8ec7-8069978758c7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:27.145753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-e16b704e-4d5f-46e8-8ce3-b33670094436 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1317 microversion: 2.1 time: 0.254242 Aug 28 10:20:27.146327 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 254/529] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:26 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:27.153897 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bb10a213-7297-4d03-8ec7-8069978758c7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:27.155351 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bb10a213-7297-4d03-8ec7-8069978758c7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:27.156532 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bb10a213-7297-4d03-8ec7-8069978758c7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.203608 Aug 28 10:20:27.157131 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 276/530] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:26 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:28.171345 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-fab4fc48-8a1c-4090-99f1-66c8fa89da63 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:28.172566 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-fab4fc48-8a1c-4090-99f1-66c8fa89da63 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:28.182728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fd92149e-ead3-4b87-9e24-4918185b4f62 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:28.183590 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fab4fc48-8a1c-4090-99f1-66c8fa89da63 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:28.183774 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fab4fc48-8a1c-4090-99f1-66c8fa89da63 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:28.183943 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fd92149e-ead3-4b87-9e24-4918185b4f62 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:28.184334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fab4fc48-8a1c-4090-99f1-66c8fa89da63 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:28.185542 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fab4fc48-8a1c-4090-99f1-66c8fa89da63 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:28.186262 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fab4fc48-8a1c-4090-99f1-66c8fa89da63 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:28.186979 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fab4fc48-8a1c-4090-99f1-66c8fa89da63 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:28.193707 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd92149e-ead3-4b87-9e24-4918185b4f62 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:28.194177 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd92149e-ead3-4b87-9e24-4918185b4f62 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:28.194583 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd92149e-ead3-4b87-9e24-4918185b4f62 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:28.195252 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd92149e-ead3-4b87-9e24-4918185b4f62 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:28.195702 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd92149e-ead3-4b87-9e24-4918185b4f62 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:28.196109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd92149e-ead3-4b87-9e24-4918185b4f62 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:28.386369 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-fab4fc48-8a1c-4090-99f1-66c8fa89da63 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:28.394864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-fab4fc48-8a1c-4090-99f1-66c8fa89da63 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1317 microversion: 2.1 time: 0.230462 Aug 28 10:20:28.397429 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 255/531] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:28 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:28.398064 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fd92149e-ead3-4b87-9e24-4918185b4f62 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:28.406906 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fd92149e-ead3-4b87-9e24-4918185b4f62 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:28.408331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fd92149e-ead3-4b87-9e24-4918185b4f62 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:28.409498 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fd92149e-ead3-4b87-9e24-4918185b4f62 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.233176 Aug 28 10:20:28.410058 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 277/532] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:28 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:28.415791 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-81a9ab0e-810f-4f0b-84e2-e78e5523cf94 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:28.416339 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-81a9ab0e-810f-4f0b-84e2-e78e5523cf94 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:28.422549 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-81a9ab0e-810f-4f0b-84e2-e78e5523cf94 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:28.423027 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-81a9ab0e-810f-4f0b-84e2-e78e5523cf94 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:28.423510 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-81a9ab0e-810f-4f0b-84e2-e78e5523cf94 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:28.424250 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-81a9ab0e-810f-4f0b-84e2-e78e5523cf94 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:28.424777 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-81a9ab0e-810f-4f0b-84e2-e78e5523cf94 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:28.425298 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-81a9ab0e-810f-4f0b-84e2-e78e5523cf94 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:28.464064 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-81a9ab0e-810f-4f0b-84e2-e78e5523cf94 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f/ips" status: 200 len: 146 microversion: 2.1 time: 0.052504 Aug 28 10:20:28.464765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 256/533] 10.222.0.40 () {58 vars in 1248 bytes} [Sun Aug 28 10:20:28 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f/ips => generated 146 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:20:29.416878 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-53c849d5-23f9-4173-baa5-2f1899af8276 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:29.417515 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-53c849d5-23f9-4173-baa5-2f1899af8276 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:29.423547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-53c849d5-23f9-4173-baa5-2f1899af8276 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:29.424018 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-53c849d5-23f9-4173-baa5-2f1899af8276 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:29.424410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-53c849d5-23f9-4173-baa5-2f1899af8276 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:29.425353 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-53c849d5-23f9-4173-baa5-2f1899af8276 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:29.425835 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-53c849d5-23f9-4173-baa5-2f1899af8276 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:29.426221 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-53c849d5-23f9-4173-baa5-2f1899af8276 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:29.433072 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8e379f7c-32c5-45e4-abc1-00d23f1a5fdc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:29.433703 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-8e379f7c-32c5-45e4-abc1-00d23f1a5fdc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:29.440161 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e379f7c-32c5-45e4-abc1-00d23f1a5fdc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:29.440976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e379f7c-32c5-45e4-abc1-00d23f1a5fdc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:29.441407 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e379f7c-32c5-45e4-abc1-00d23f1a5fdc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:29.442113 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e379f7c-32c5-45e4-abc1-00d23f1a5fdc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:29.442581 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e379f7c-32c5-45e4-abc1-00d23f1a5fdc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:29.442996 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e379f7c-32c5-45e4-abc1-00d23f1a5fdc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:29.616915 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-53c849d5-23f9-4173-baa5-2f1899af8276 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:29.625053 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-53c849d5-23f9-4173-baa5-2f1899af8276 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1317 microversion: 2.1 time: 0.212329 Aug 28 10:20:29.625640 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 278/534] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:29 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:29.640476 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8e379f7c-32c5-45e4-abc1-00d23f1a5fdc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:29.649347 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8e379f7c-32c5-45e4-abc1-00d23f1a5fdc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:29.650758 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8e379f7c-32c5-45e4-abc1-00d23f1a5fdc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:29.651915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-8e379f7c-32c5-45e4-abc1-00d23f1a5fdc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.223062 Aug 28 10:20:29.652458 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 257/535] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:29 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:30.650218 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a0ce03b9-c995-4d4e-b183-393f856c972a tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:30.652051 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a0ce03b9-c995-4d4e-b183-393f856c972a tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:30.662017 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a0ce03b9-c995-4d4e-b183-393f856c972a tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:30.662493 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a0ce03b9-c995-4d4e-b183-393f856c972a tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:30.662918 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a0ce03b9-c995-4d4e-b183-393f856c972a tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:30.663609 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a0ce03b9-c995-4d4e-b183-393f856c972a tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:30.664054 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a0ce03b9-c995-4d4e-b183-393f856c972a tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:30.664465 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a0ce03b9-c995-4d4e-b183-393f856c972a tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:30.674816 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-53f1c06c-7341-4be7-a1af-0da72b9ef486 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:30.675295 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-53f1c06c-7341-4be7-a1af-0da72b9ef486 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:30.681738 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-53f1c06c-7341-4be7-a1af-0da72b9ef486 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:30.682219 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-53f1c06c-7341-4be7-a1af-0da72b9ef486 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:30.682633 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-53f1c06c-7341-4be7-a1af-0da72b9ef486 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:30.683314 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-53f1c06c-7341-4be7-a1af-0da72b9ef486 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:30.683782 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-53f1c06c-7341-4be7-a1af-0da72b9ef486 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:30.684191 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-53f1c06c-7341-4be7-a1af-0da72b9ef486 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:30.877807 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a0ce03b9-c995-4d4e-b183-393f856c972a tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:30.886977 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-53f1c06c-7341-4be7-a1af-0da72b9ef486 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:30.887440 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a0ce03b9-c995-4d4e-b183-393f856c972a tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1317 microversion: 2.1 time: 0.243776 Aug 28 10:20:30.888221 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 279/536] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:30 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:30.896089 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-53f1c06c-7341-4be7-a1af-0da72b9ef486 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:30.897537 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-53f1c06c-7341-4be7-a1af-0da72b9ef486 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:30.898684 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-53f1c06c-7341-4be7-a1af-0da72b9ef486 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.227907 Aug 28 10:20:30.899218 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 258/537] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:30 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:31.548031 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-160d38da-fd16-437c-abda-b645780367fb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0cfb614-7d8c-44bf-9122-5db4ab27e702"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:20:31.550536 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-160d38da-fd16-437c-abda-b645780367fb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:31.556879 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-160d38da-fd16-437c-abda-b645780367fb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:31.557357 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-160d38da-fd16-437c-abda-b645780367fb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:31.557787 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-160d38da-fd16-437c-abda-b645780367fb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:31.558476 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-160d38da-fd16-437c-abda-b645780367fb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:31.558924 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-160d38da-fd16-437c-abda-b645780367fb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:31.559353 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-160d38da-fd16-437c-abda-b645780367fb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:31.912465 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-2c742182-a7d9-44d2-8e32-30e65d260f72 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:31.913441 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-2c742182-a7d9-44d2-8e32-30e65d260f72 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:31.920813 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2c742182-a7d9-44d2-8e32-30e65d260f72 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:31.921290 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2c742182-a7d9-44d2-8e32-30e65d260f72 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:31.921709 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2c742182-a7d9-44d2-8e32-30e65d260f72 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:31.922397 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2c742182-a7d9-44d2-8e32-30e65d260f72 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:31.922843 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2c742182-a7d9-44d2-8e32-30e65d260f72 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:31.923258 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2c742182-a7d9-44d2-8e32-30e65d260f72 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:32.054090 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-2c742182-a7d9-44d2-8e32-30e65d260f72 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:32.062609 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-2c742182-a7d9-44d2-8e32-30e65d260f72 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1317 microversion: 2.1 time: 0.156521 Aug 28 10:20:32.063156 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 259/538] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:31 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:32.067489 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-3c8a94a5-5fbd-4561-a0b1-6eb7e9b56735 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:32.068080 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-3c8a94a5-5fbd-4561-a0b1-6eb7e9b56735 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:32.073683 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3c8a94a5-5fbd-4561-a0b1-6eb7e9b56735 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:32.074160 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3c8a94a5-5fbd-4561-a0b1-6eb7e9b56735 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:32.074582 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3c8a94a5-5fbd-4561-a0b1-6eb7e9b56735 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:32.075258 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3c8a94a5-5fbd-4561-a0b1-6eb7e9b56735 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:32.075701 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3c8a94a5-5fbd-4561-a0b1-6eb7e9b56735 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:32.076114 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3c8a94a5-5fbd-4561-a0b1-6eb7e9b56735 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:32.211232 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-3c8a94a5-5fbd-4561-a0b1-6eb7e9b56735 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:32.220538 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-3c8a94a5-5fbd-4561-a0b1-6eb7e9b56735 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:32.221998 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-3c8a94a5-5fbd-4561-a0b1-6eb7e9b56735 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:32.223155 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-3c8a94a5-5fbd-4561-a0b1-6eb7e9b56735 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.159061 Aug 28 10:20:32.223704 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 260/539] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:32 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:33.086468 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4ee9ec58-d055-4b20-9c18-0972ba2d1770 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:33.087128 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4ee9ec58-d055-4b20-9c18-0972ba2d1770 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:33.094054 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4ee9ec58-d055-4b20-9c18-0972ba2d1770 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:33.094535 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4ee9ec58-d055-4b20-9c18-0972ba2d1770 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:33.094961 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4ee9ec58-d055-4b20-9c18-0972ba2d1770 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:33.095643 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4ee9ec58-d055-4b20-9c18-0972ba2d1770 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:33.096106 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4ee9ec58-d055-4b20-9c18-0972ba2d1770 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:33.096545 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4ee9ec58-d055-4b20-9c18-0972ba2d1770 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:33.234407 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4ee9ec58-d055-4b20-9c18-0972ba2d1770 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:33.242265 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4ee9ec58-d055-4b20-9c18-0972ba2d1770 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1317 microversion: 2.1 time: 0.161599 Aug 28 10:20:33.248560 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 261/540] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:33 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:33.248560 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-36b7ee55-03f3-4a2c-a862-8dce464b6179 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:33.248560 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-36b7ee55-03f3-4a2c-a862-8dce464b6179 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:33.253738 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-36b7ee55-03f3-4a2c-a862-8dce464b6179 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:33.254216 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-36b7ee55-03f3-4a2c-a862-8dce464b6179 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:33.254636 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-36b7ee55-03f3-4a2c-a862-8dce464b6179 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:33.255280 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-36b7ee55-03f3-4a2c-a862-8dce464b6179 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:33.255721 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-36b7ee55-03f3-4a2c-a862-8dce464b6179 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:33.256132 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-36b7ee55-03f3-4a2c-a862-8dce464b6179 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:33.390726 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-36b7ee55-03f3-4a2c-a862-8dce464b6179 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:33.399383 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-36b7ee55-03f3-4a2c-a862-8dce464b6179 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:33.400823 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-36b7ee55-03f3-4a2c-a862-8dce464b6179 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:33.401958 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-36b7ee55-03f3-4a2c-a862-8dce464b6179 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.158236 Aug 28 10:20:33.402549 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 262/541] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:33 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:34.266670 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-01f105b2-d7f8-4d14-a9b1-87ec4c678fe6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:34.267899 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-01f105b2-d7f8-4d14-a9b1-87ec4c678fe6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:34.276283 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-01f105b2-d7f8-4d14-a9b1-87ec4c678fe6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:34.276793 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-01f105b2-d7f8-4d14-a9b1-87ec4c678fe6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:34.277219 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-01f105b2-d7f8-4d14-a9b1-87ec4c678fe6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:34.277899 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-01f105b2-d7f8-4d14-a9b1-87ec4c678fe6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:34.278346 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-01f105b2-d7f8-4d14-a9b1-87ec4c678fe6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:34.278765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-01f105b2-d7f8-4d14-a9b1-87ec4c678fe6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:34.417787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-01f105b2-d7f8-4d14-a9b1-87ec4c678fe6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:34.426574 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-01f105b2-d7f8-4d14-a9b1-87ec4c678fe6 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1317 microversion: 2.1 time: 0.166260 Aug 28 10:20:34.427162 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 263/542] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:34 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:34.431969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8e70f417-2664-466f-96a6-17e95404073a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:34.432692 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-8e70f417-2664-466f-96a6-17e95404073a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:34.438890 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e70f417-2664-466f-96a6-17e95404073a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:34.439639 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e70f417-2664-466f-96a6-17e95404073a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:34.440356 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e70f417-2664-466f-96a6-17e95404073a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:34.441299 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e70f417-2664-466f-96a6-17e95404073a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:34.441953 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e70f417-2664-466f-96a6-17e95404073a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:34.442639 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e70f417-2664-466f-96a6-17e95404073a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:34.497045 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-160d38da-fd16-437c-abda-b645780367fb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "POST /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.952778 Aug 28 10:20:34.498305 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 280/543] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Aug 28 10:20:31 2022] POST /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f/os-volume_attachments => generated 194 bytes in 2955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:20:34.581251 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8e70f417-2664-466f-96a6-17e95404073a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:34.590366 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8e70f417-2664-466f-96a6-17e95404073a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:34.591792 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8e70f417-2664-466f-96a6-17e95404073a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:34.592990 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-8e70f417-2664-466f-96a6-17e95404073a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.164649 Aug 28 10:20:34.593573 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 264/544] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:34 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:35.448454 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8ca8c723-172c-4030-806f-09541bd7e267 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:35.449169 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8ca8c723-172c-4030-806f-09541bd7e267 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:35.455507 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8ca8c723-172c-4030-806f-09541bd7e267 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:35.455977 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8ca8c723-172c-4030-806f-09541bd7e267 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:35.456402 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8ca8c723-172c-4030-806f-09541bd7e267 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:35.457109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8ca8c723-172c-4030-806f-09541bd7e267 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:35.457524 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8ca8c723-172c-4030-806f-09541bd7e267 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:35.457955 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8ca8c723-172c-4030-806f-09541bd7e267 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:35.592866 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8ca8c723-172c-4030-806f-09541bd7e267 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:35.600475 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8ca8c723-172c-4030-806f-09541bd7e267 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1317 microversion: 2.1 time: 0.156873 Aug 28 10:20:35.601066 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 281/545] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:35 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:35.616721 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-d8c1ad45-d147-4da5-81cd-0569df4bc538 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:35.616721 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-d8c1ad45-d147-4da5-81cd-0569df4bc538 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:35.622143 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d8c1ad45-d147-4da5-81cd-0569df4bc538 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:35.622611 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d8c1ad45-d147-4da5-81cd-0569df4bc538 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:35.623029 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d8c1ad45-d147-4da5-81cd-0569df4bc538 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:35.623696 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d8c1ad45-d147-4da5-81cd-0569df4bc538 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:35.624132 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d8c1ad45-d147-4da5-81cd-0569df4bc538 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:35.624559 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d8c1ad45-d147-4da5-81cd-0569df4bc538 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:35.778581 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d8c1ad45-d147-4da5-81cd-0569df4bc538 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:35.787411 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d8c1ad45-d147-4da5-81cd-0569df4bc538 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:35.788906 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d8c1ad45-d147-4da5-81cd-0569df4bc538 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:35.790110 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-d8c1ad45-d147-4da5-81cd-0569df4bc538 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.178742 Aug 28 10:20:35.790974 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 265/546] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:35 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:36.621282 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f3c035e1-dee0-447c-afe2-cd681e915d8f tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:36.621856 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f3c035e1-dee0-447c-afe2-cd681e915d8f tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:36.628708 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3c035e1-dee0-447c-afe2-cd681e915d8f tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:36.629206 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3c035e1-dee0-447c-afe2-cd681e915d8f tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:36.629767 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3c035e1-dee0-447c-afe2-cd681e915d8f tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:36.630424 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3c035e1-dee0-447c-afe2-cd681e915d8f tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:36.630879 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3c035e1-dee0-447c-afe2-cd681e915d8f tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:36.631336 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3c035e1-dee0-447c-afe2-cd681e915d8f tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:36.770154 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f3c035e1-dee0-447c-afe2-cd681e915d8f tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:36.782175 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f3c035e1-dee0-447c-afe2-cd681e915d8f tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1317 microversion: 2.1 time: 0.164604 Aug 28 10:20:36.783173 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 282/547] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:36 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:36.813536 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f277ba06-aa67-41fd-b46e-52060c2b37f9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:36.814105 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f277ba06-aa67-41fd-b46e-52060c2b37f9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:36.821324 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f277ba06-aa67-41fd-b46e-52060c2b37f9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:36.821794 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f277ba06-aa67-41fd-b46e-52060c2b37f9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:36.822219 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f277ba06-aa67-41fd-b46e-52060c2b37f9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:36.822915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f277ba06-aa67-41fd-b46e-52060c2b37f9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:36.823353 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f277ba06-aa67-41fd-b46e-52060c2b37f9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:36.823769 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f277ba06-aa67-41fd-b46e-52060c2b37f9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:36.960236 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f277ba06-aa67-41fd-b46e-52060c2b37f9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:36.969347 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f277ba06-aa67-41fd-b46e-52060c2b37f9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:36.970769 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f277ba06-aa67-41fd-b46e-52060c2b37f9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:36.971913 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f277ba06-aa67-41fd-b46e-52060c2b37f9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.162424 Aug 28 10:20:36.972467 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 266/548] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:36 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:37.810640 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ccf48b53-ef53-411e-9b8f-b565aa4e1f88 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:37.811661 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ccf48b53-ef53-411e-9b8f-b565aa4e1f88 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:37.822534 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ccf48b53-ef53-411e-9b8f-b565aa4e1f88 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:37.823319 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ccf48b53-ef53-411e-9b8f-b565aa4e1f88 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:37.824021 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ccf48b53-ef53-411e-9b8f-b565aa4e1f88 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:37.825258 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ccf48b53-ef53-411e-9b8f-b565aa4e1f88 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:37.825996 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ccf48b53-ef53-411e-9b8f-b565aa4e1f88 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:37.826701 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ccf48b53-ef53-411e-9b8f-b565aa4e1f88 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:37.965659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ccf48b53-ef53-411e-9b8f-b565aa4e1f88 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:37.976880 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ccf48b53-ef53-411e-9b8f-b565aa4e1f88 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1507 microversion: 2.1 time: 0.172514 Aug 28 10:20:37.977648 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 283/549] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:37 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:37.996692 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f745f22b-7b0b-448d-8af5-9753fa105b94 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:37.997261 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-98e7ea0f-d665-4153-b6ce-0f39ab386c26 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45278489-820c-4cfe-9bdc-e370a1b1af0e", "device": "/dev/sdb"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:20:37.997382 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f745f22b-7b0b-448d-8af5-9753fa105b94 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:37.999717 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-98e7ea0f-d665-4153-b6ce-0f39ab386c26 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:38.003959 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f745f22b-7b0b-448d-8af5-9753fa105b94 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:38.004431 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f745f22b-7b0b-448d-8af5-9753fa105b94 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:38.004884 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f745f22b-7b0b-448d-8af5-9753fa105b94 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:38.005558 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f745f22b-7b0b-448d-8af5-9753fa105b94 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:38.005697 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98e7ea0f-d665-4153-b6ce-0f39ab386c26 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:38.005994 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f745f22b-7b0b-448d-8af5-9753fa105b94 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:38.006181 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98e7ea0f-d665-4153-b6ce-0f39ab386c26 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:38.006400 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f745f22b-7b0b-448d-8af5-9753fa105b94 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:38.006635 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98e7ea0f-d665-4153-b6ce-0f39ab386c26 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:38.007317 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98e7ea0f-d665-4153-b6ce-0f39ab386c26 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:38.007757 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98e7ea0f-d665-4153-b6ce-0f39ab386c26 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:38.008205 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98e7ea0f-d665-4153-b6ce-0f39ab386c26 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:38.137259 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f745f22b-7b0b-448d-8af5-9753fa105b94 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:38.148002 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f745f22b-7b0b-448d-8af5-9753fa105b94 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:38.149486 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f745f22b-7b0b-448d-8af5-9753fa105b94 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:38.150659 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f745f22b-7b0b-448d-8af5-9753fa105b94 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.157951 Aug 28 10:20:38.151243 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 267/550] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:37 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:38.284915 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-98e7ea0f-d665-4153-b6ce-0f39ab386c26 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "POST /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291546 Aug 28 10:20:38.285538 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 284/551] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Aug 28 10:20:37 2022] POST /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:20:39.178689 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4feca38c-3da8-49ef-98bb-0431ee2e521f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:39.179671 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4feca38c-3da8-49ef-98bb-0431ee2e521f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:39.190664 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4feca38c-3da8-49ef-98bb-0431ee2e521f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:39.191458 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4feca38c-3da8-49ef-98bb-0431ee2e521f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:39.192176 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4feca38c-3da8-49ef-98bb-0431ee2e521f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:39.193355 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4feca38c-3da8-49ef-98bb-0431ee2e521f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:39.194103 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4feca38c-3da8-49ef-98bb-0431ee2e521f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:39.194821 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4feca38c-3da8-49ef-98bb-0431ee2e521f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:39.333642 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4feca38c-3da8-49ef-98bb-0431ee2e521f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:39.342966 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4feca38c-3da8-49ef-98bb-0431ee2e521f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:39.344392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4feca38c-3da8-49ef-98bb-0431ee2e521f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:39.345564 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4feca38c-3da8-49ef-98bb-0431ee2e521f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.173621 Aug 28 10:20:39.346128 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 268/552] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:39 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:40.374747 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ce8fde42-8db3-4d6a-a811-ea83fd5c6371 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:40.375870 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ce8fde42-8db3-4d6a-a811-ea83fd5c6371 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:40.385507 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ce8fde42-8db3-4d6a-a811-ea83fd5c6371 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:40.385981 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ce8fde42-8db3-4d6a-a811-ea83fd5c6371 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:40.386405 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ce8fde42-8db3-4d6a-a811-ea83fd5c6371 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:40.387097 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ce8fde42-8db3-4d6a-a811-ea83fd5c6371 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:40.387541 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ce8fde42-8db3-4d6a-a811-ea83fd5c6371 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:40.387927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ce8fde42-8db3-4d6a-a811-ea83fd5c6371 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:40.517505 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ce8fde42-8db3-4d6a-a811-ea83fd5c6371 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:40.526444 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ce8fde42-8db3-4d6a-a811-ea83fd5c6371 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:40.527927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ce8fde42-8db3-4d6a-a811-ea83fd5c6371 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:40.529129 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ce8fde42-8db3-4d6a-a811-ea83fd5c6371 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.162531 Aug 28 10:20:40.529718 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 285/553] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:40 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:41.556367 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-49d59ae7-6f7a-4c52-b887-ae0112883a73 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:41.557151 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-49d59ae7-6f7a-4c52-b887-ae0112883a73 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:41.565444 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-49d59ae7-6f7a-4c52-b887-ae0112883a73 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:41.566035 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-49d59ae7-6f7a-4c52-b887-ae0112883a73 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:41.566565 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-49d59ae7-6f7a-4c52-b887-ae0112883a73 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:41.567402 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-49d59ae7-6f7a-4c52-b887-ae0112883a73 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:41.567954 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-49d59ae7-6f7a-4c52-b887-ae0112883a73 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:41.568494 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-49d59ae7-6f7a-4c52-b887-ae0112883a73 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:41.703502 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-49d59ae7-6f7a-4c52-b887-ae0112883a73 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:41.712205 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-49d59ae7-6f7a-4c52-b887-ae0112883a73 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:41.713646 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-49d59ae7-6f7a-4c52-b887-ae0112883a73 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:41.714782 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-49d59ae7-6f7a-4c52-b887-ae0112883a73 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.164861 Aug 28 10:20:41.715338 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 269/554] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:41 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:42.740443 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4aacd1cf-a702-4577-aeab-19ec0189bae2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:42.741164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4aacd1cf-a702-4577-aeab-19ec0189bae2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:42.750212 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4aacd1cf-a702-4577-aeab-19ec0189bae2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:42.750862 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4aacd1cf-a702-4577-aeab-19ec0189bae2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:42.751428 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4aacd1cf-a702-4577-aeab-19ec0189bae2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:42.752366 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4aacd1cf-a702-4577-aeab-19ec0189bae2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:42.752957 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4aacd1cf-a702-4577-aeab-19ec0189bae2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:42.753504 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4aacd1cf-a702-4577-aeab-19ec0189bae2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:42.889069 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4aacd1cf-a702-4577-aeab-19ec0189bae2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:42.902232 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4aacd1cf-a702-4577-aeab-19ec0189bae2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:42.904401 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4aacd1cf-a702-4577-aeab-19ec0189bae2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:42.906211 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4aacd1cf-a702-4577-aeab-19ec0189bae2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.170870 Aug 28 10:20:42.906934 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 286/555] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:42 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:43.931660 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-21001139-b76c-401d-af6e-d147940f4b97 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:43.932310 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-21001139-b76c-401d-af6e-d147940f4b97 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:43.939185 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-21001139-b76c-401d-af6e-d147940f4b97 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:43.939667 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-21001139-b76c-401d-af6e-d147940f4b97 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:43.940089 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-21001139-b76c-401d-af6e-d147940f4b97 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:43.940793 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-21001139-b76c-401d-af6e-d147940f4b97 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:43.941238 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-21001139-b76c-401d-af6e-d147940f4b97 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:43.941653 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-21001139-b76c-401d-af6e-d147940f4b97 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:44.222174 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-01df3708-31fe-41ce-a82a-4e65cba59b4b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:20:44.229303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01df3708-31fe-41ce-a82a-4e65cba59b4b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:44.229868 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01df3708-31fe-41ce-a82a-4e65cba59b4b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:44.230364 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01df3708-31fe-41ce-a82a-4e65cba59b4b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:44.294533 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-01df3708-31fe-41ce-a82a-4e65cba59b4b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Going to try to stop instance {{(pid=120663) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 28 10:20:44.310663 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-21001139-b76c-401d-af6e-d147940f4b97 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:44.313344 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=100 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:20:44.321629 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-21001139-b76c-401d-af6e-d147940f4b97 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:44.323218 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-21001139-b76c-401d-af6e-d147940f4b97 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:44.324379 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-21001139-b76c-401d-af6e-d147940f4b97 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.396815 Aug 28 10:20:44.324972 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 270/556] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:43 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:44.352178 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-01df3708-31fe-41ce-a82a-4e65cba59b4b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "POST /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f/action" status: 202 len: 0 microversion: 2.1 time: 0.133694 Aug 28 10:20:44.352934 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 287/557] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Aug 28 10:20:44 2022] POST /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:20:44.361002 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-d23649f8-c477-4f85-b31f-29eb7ac5c101 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:44.361705 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-d23649f8-c477-4f85-b31f-29eb7ac5c101 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:44.367448 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=54 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:20:44.369166 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d23649f8-c477-4f85-b31f-29eb7ac5c101 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:44.369755 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d23649f8-c477-4f85-b31f-29eb7ac5c101 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:44.370162 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d23649f8-c477-4f85-b31f-29eb7ac5c101 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:44.370864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d23649f8-c477-4f85-b31f-29eb7ac5c101 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:44.371308 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d23649f8-c477-4f85-b31f-29eb7ac5c101 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:44.371732 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d23649f8-c477-4f85-b31f-29eb7ac5c101 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:44.560932 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d23649f8-c477-4f85-b31f-29eb7ac5c101 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:44.569346 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-d23649f8-c477-4f85-b31f-29eb7ac5c101 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1723 microversion: 2.1 time: 0.212180 Aug 28 10:20:44.569974 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 271/558] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:44 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:45.353074 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-be319a61-cbaa-4822-b1f7-5da58b55b56c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:45.354211 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-be319a61-cbaa-4822-b1f7-5da58b55b56c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:45.364824 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-be319a61-cbaa-4822-b1f7-5da58b55b56c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:45.365614 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-be319a61-cbaa-4822-b1f7-5da58b55b56c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:45.366311 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-be319a61-cbaa-4822-b1f7-5da58b55b56c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:45.367430 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-be319a61-cbaa-4822-b1f7-5da58b55b56c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:45.368170 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-be319a61-cbaa-4822-b1f7-5da58b55b56c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:45.368900 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-be319a61-cbaa-4822-b1f7-5da58b55b56c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:45.383794 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:20:45.576557 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-be319a61-cbaa-4822-b1f7-5da58b55b56c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:45.588782 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-be319a61-cbaa-4822-b1f7-5da58b55b56c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:45.590255 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-be319a61-cbaa-4822-b1f7-5da58b55b56c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:45.590815 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8e9e7b85-9447-4124-8928-fbbd25af6416 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:45.591419 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-8e9e7b85-9447-4124-8928-fbbd25af6416 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:45.591567 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-be319a61-cbaa-4822-b1f7-5da58b55b56c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.246470 Aug 28 10:20:45.592134 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 288/559] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:45 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:45.598214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e9e7b85-9447-4124-8928-fbbd25af6416 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:45.598694 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e9e7b85-9447-4124-8928-fbbd25af6416 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:45.599120 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e9e7b85-9447-4124-8928-fbbd25af6416 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:45.599810 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e9e7b85-9447-4124-8928-fbbd25af6416 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:45.600258 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e9e7b85-9447-4124-8928-fbbd25af6416 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:45.601375 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8e9e7b85-9447-4124-8928-fbbd25af6416 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:45.743395 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8e9e7b85-9447-4124-8928-fbbd25af6416 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:45.751847 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-8e9e7b85-9447-4124-8928-fbbd25af6416 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1723 microversion: 2.1 time: 0.164994 Aug 28 10:20:45.752383 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 272/560] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:45 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:45.959047 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-e571b009-979a-4cc7-acaf-e65120c637bd req-7df295b2-a272-421a-8dee-2b38ad29e3dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a0819fc-2347-457b-804f-7ef819596193", "name": "network-vif-plugged", "status": "completed", "tag": "fe1c34ee-5586-4bd0-a9a5-7cc7349b7bd2"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:20:45.971294 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-e571b009-979a-4cc7-acaf-e65120c637bd req-7df295b2-a272-421a-8dee-2b38ad29e3dd service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:45.972877 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-e571b009-979a-4cc7-acaf-e65120c637bd req-7df295b2-a272-421a-8dee-2b38ad29e3dd service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:45.973505 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-e571b009-979a-4cc7-acaf-e65120c637bd req-7df295b2-a272-421a-8dee-2b38ad29e3dd service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:45.985750 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-e571b009-979a-4cc7-acaf-e65120c637bd req-7df295b2-a272-421a-8dee-2b38ad29e3dd service nova] Creating event network-vif-plugged:fe1c34ee-5586-4bd0-a9a5-7cc7349b7bd2 for instance 2a0819fc-2347-457b-804f-7ef819596193 on hv-cinder-85200 Aug 28 10:20:45.990700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-e571b009-979a-4cc7-acaf-e65120c637bd req-7df295b2-a272-421a-8dee-2b38ad29e3dd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035441 Aug 28 10:20:45.991675 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 289/561] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:20:46.615653 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f5c1d971-2e22-461f-bbc1-9ca503afebd9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:46.616243 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f5c1d971-2e22-461f-bbc1-9ca503afebd9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:46.622894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f5c1d971-2e22-461f-bbc1-9ca503afebd9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:46.623333 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f5c1d971-2e22-461f-bbc1-9ca503afebd9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:46.623810 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f5c1d971-2e22-461f-bbc1-9ca503afebd9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:46.624467 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f5c1d971-2e22-461f-bbc1-9ca503afebd9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:46.624980 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f5c1d971-2e22-461f-bbc1-9ca503afebd9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:46.625392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f5c1d971-2e22-461f-bbc1-9ca503afebd9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:46.755753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f5c1d971-2e22-461f-bbc1-9ca503afebd9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:46.764654 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f5c1d971-2e22-461f-bbc1-9ca503afebd9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:46.766094 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f5c1d971-2e22-461f-bbc1-9ca503afebd9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:46.767293 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f5c1d971-2e22-461f-bbc1-9ca503afebd9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.155666 Aug 28 10:20:46.768408 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 273/562] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:46 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:46.774131 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6ca715ca-5641-413a-b58e-5237407e82ee tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:46.775171 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6ca715ca-5641-413a-b58e-5237407e82ee tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:46.782362 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ca715ca-5641-413a-b58e-5237407e82ee tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:46.782981 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ca715ca-5641-413a-b58e-5237407e82ee tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:46.783408 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ca715ca-5641-413a-b58e-5237407e82ee tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:46.784105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ca715ca-5641-413a-b58e-5237407e82ee tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:46.784577 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ca715ca-5641-413a-b58e-5237407e82ee tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:46.784997 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ca715ca-5641-413a-b58e-5237407e82ee tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:46.920382 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6ca715ca-5641-413a-b58e-5237407e82ee tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:46.931702 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6ca715ca-5641-413a-b58e-5237407e82ee tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1723 microversion: 2.1 time: 0.161859 Aug 28 10:20:46.932283 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 290/563] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:46 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:47.795498 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-9fbc2401-0840-43c6-8ce1-6f11d93bbe0d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:47.796473 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-9fbc2401-0840-43c6-8ce1-6f11d93bbe0d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:47.807015 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9fbc2401-0840-43c6-8ce1-6f11d93bbe0d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:47.807488 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9fbc2401-0840-43c6-8ce1-6f11d93bbe0d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:47.807908 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9fbc2401-0840-43c6-8ce1-6f11d93bbe0d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:47.808638 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9fbc2401-0840-43c6-8ce1-6f11d93bbe0d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:47.809406 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9fbc2401-0840-43c6-8ce1-6f11d93bbe0d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:47.809820 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9fbc2401-0840-43c6-8ce1-6f11d93bbe0d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:47.950766 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-9fbc2401-0840-43c6-8ce1-6f11d93bbe0d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:47.952882 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-62f32f4b-a3b2-4e37-a17a-74e15db5cac1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:47.953488 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-62f32f4b-a3b2-4e37-a17a-74e15db5cac1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:47.960058 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62f32f4b-a3b2-4e37-a17a-74e15db5cac1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:47.960210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-9fbc2401-0840-43c6-8ce1-6f11d93bbe0d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:47.960568 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62f32f4b-a3b2-4e37-a17a-74e15db5cac1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:47.960998 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62f32f4b-a3b2-4e37-a17a-74e15db5cac1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:47.961605 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-9fbc2401-0840-43c6-8ce1-6f11d93bbe0d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:47.961738 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62f32f4b-a3b2-4e37-a17a-74e15db5cac1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:47.962147 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62f32f4b-a3b2-4e37-a17a-74e15db5cac1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:47.962536 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62f32f4b-a3b2-4e37-a17a-74e15db5cac1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:47.962761 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-9fbc2401-0840-43c6-8ce1-6f11d93bbe0d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.174251 Aug 28 10:20:47.963347 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 274/564] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:47 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:48.092329 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-62f32f4b-a3b2-4e37-a17a-74e15db5cac1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:48.100960 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-62f32f4b-a3b2-4e37-a17a-74e15db5cac1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1723 microversion: 2.1 time: 0.151804 Aug 28 10:20:48.101515 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 291/565] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:47 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:48.985780 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c124b730-1782-40cf-a08e-6385fd81548b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:48.986929 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c124b730-1782-40cf-a08e-6385fd81548b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:48.993195 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c124b730-1782-40cf-a08e-6385fd81548b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:48.993358 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c124b730-1782-40cf-a08e-6385fd81548b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:48.993836 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c124b730-1782-40cf-a08e-6385fd81548b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:48.994529 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c124b730-1782-40cf-a08e-6385fd81548b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:48.994976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c124b730-1782-40cf-a08e-6385fd81548b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:48.995493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c124b730-1782-40cf-a08e-6385fd81548b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:49.122114 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-25fbe9f1-7224-4b5b-a9f6-4fd3e7236975 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:49.122920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-25fbe9f1-7224-4b5b-a9f6-4fd3e7236975 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:49.125927 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c124b730-1782-40cf-a08e-6385fd81548b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:49.129693 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25fbe9f1-7224-4b5b-a9f6-4fd3e7236975 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:49.132291 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25fbe9f1-7224-4b5b-a9f6-4fd3e7236975 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:49.132919 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25fbe9f1-7224-4b5b-a9f6-4fd3e7236975 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:49.133691 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25fbe9f1-7224-4b5b-a9f6-4fd3e7236975 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:49.134253 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25fbe9f1-7224-4b5b-a9f6-4fd3e7236975 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:49.134735 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25fbe9f1-7224-4b5b-a9f6-4fd3e7236975 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:49.134863 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c124b730-1782-40cf-a08e-6385fd81548b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:49.136417 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c124b730-1782-40cf-a08e-6385fd81548b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:49.137794 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c124b730-1782-40cf-a08e-6385fd81548b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1809 microversion: 2.20 time: 0.156062 Aug 28 10:20:49.138606 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 275/566] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:48 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:49.266308 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-25fbe9f1-7224-4b5b-a9f6-4fd3e7236975 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:49.274789 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-25fbe9f1-7224-4b5b-a9f6-4fd3e7236975 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1723 microversion: 2.1 time: 0.156520 Aug 28 10:20:49.275361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 292/567] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:49 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:20:50.166259 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-14fcf11c-d766-485d-a958-a62ab015a91a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:50.166840 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-14fcf11c-d766-485d-a958-a62ab015a91a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:50.173809 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-14fcf11c-d766-485d-a958-a62ab015a91a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:50.174282 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-14fcf11c-d766-485d-a958-a62ab015a91a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:50.174703 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-14fcf11c-d766-485d-a958-a62ab015a91a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:50.175381 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-14fcf11c-d766-485d-a958-a62ab015a91a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:50.175821 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-14fcf11c-d766-485d-a958-a62ab015a91a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:50.176234 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-14fcf11c-d766-485d-a958-a62ab015a91a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:50.296584 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-822a024b-1fe0-4136-b5cd-5236a9ebbd6a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:50.297094 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-822a024b-1fe0-4136-b5cd-5236a9ebbd6a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:50.299437 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=46 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:20:50.305325 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-822a024b-1fe0-4136-b5cd-5236a9ebbd6a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:50.305792 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-822a024b-1fe0-4136-b5cd-5236a9ebbd6a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:50.306405 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-822a024b-1fe0-4136-b5cd-5236a9ebbd6a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:50.307402 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-822a024b-1fe0-4136-b5cd-5236a9ebbd6a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:50.307848 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-822a024b-1fe0-4136-b5cd-5236a9ebbd6a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:50.308262 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-822a024b-1fe0-4136-b5cd-5236a9ebbd6a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:50.309534 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-14fcf11c-d766-485d-a958-a62ab015a91a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:50.318965 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-14fcf11c-d766-485d-a958-a62ab015a91a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:50.320433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-14fcf11c-d766-485d-a958-a62ab015a91a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:50.321674 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-14fcf11c-d766-485d-a958-a62ab015a91a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1796 microversion: 2.20 time: 0.162423 Aug 28 10:20:50.322497 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 276/568] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:20:50 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1796 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:20:50.437139 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-822a024b-1fe0-4136-b5cd-5236a9ebbd6a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:50.445552 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-822a024b-1fe0-4136-b5cd-5236a9ebbd6a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1723 microversion: 2.1 time: 0.153069 Aug 28 10:20:50.446112 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 293/569] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:50 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:51.470742 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-90e93e31-2a57-4e87-a43c-f8667efe2039 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:51.471734 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-90e93e31-2a57-4e87-a43c-f8667efe2039 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:51.481257 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-90e93e31-2a57-4e87-a43c-f8667efe2039 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:51.481760 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-90e93e31-2a57-4e87-a43c-f8667efe2039 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:51.482170 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-90e93e31-2a57-4e87-a43c-f8667efe2039 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:51.482855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-90e93e31-2a57-4e87-a43c-f8667efe2039 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:51.483303 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-90e93e31-2a57-4e87-a43c-f8667efe2039 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:51.483726 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-90e93e31-2a57-4e87-a43c-f8667efe2039 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:51.617035 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-90e93e31-2a57-4e87-a43c-f8667efe2039 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:51.625631 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-90e93e31-2a57-4e87-a43c-f8667efe2039 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1723 microversion: 2.1 time: 0.161482 Aug 28 10:20:51.626247 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 277/570] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:51 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:52.647532 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-32c5c4c4-2b7a-424f-aeaf-3ef5522b47b9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:52.648218 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-32c5c4c4-2b7a-424f-aeaf-3ef5522b47b9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:52.655073 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-32c5c4c4-2b7a-424f-aeaf-3ef5522b47b9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:52.655549 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-32c5c4c4-2b7a-424f-aeaf-3ef5522b47b9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:52.655974 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-32c5c4c4-2b7a-424f-aeaf-3ef5522b47b9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:52.656696 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-32c5c4c4-2b7a-424f-aeaf-3ef5522b47b9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:52.657141 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-32c5c4c4-2b7a-424f-aeaf-3ef5522b47b9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:52.657563 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-32c5c4c4-2b7a-424f-aeaf-3ef5522b47b9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:52.807250 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-32c5c4c4-2b7a-424f-aeaf-3ef5522b47b9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:52.815813 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-32c5c4c4-2b7a-424f-aeaf-3ef5522b47b9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1723 microversion: 2.1 time: 0.172265 Aug 28 10:20:52.816384 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 294/571] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:52 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:53.841194 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c5b47784-7125-4c28-b956-f653ddbd2388 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:53.842392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c5b47784-7125-4c28-b956-f653ddbd2388 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:53.853961 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c5b47784-7125-4c28-b956-f653ddbd2388 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:53.854380 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c5b47784-7125-4c28-b956-f653ddbd2388 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:53.854810 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c5b47784-7125-4c28-b956-f653ddbd2388 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:53.855493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c5b47784-7125-4c28-b956-f653ddbd2388 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:53.855942 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c5b47784-7125-4c28-b956-f653ddbd2388 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:53.856361 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c5b47784-7125-4c28-b956-f653ddbd2388 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:53.996429 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c5b47784-7125-4c28-b956-f653ddbd2388 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:54.004907 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c5b47784-7125-4c28-b956-f653ddbd2388 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1723 microversion: 2.1 time: 0.170399 Aug 28 10:20:54.005484 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 278/572] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:53 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:55.026772 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f070e965-9f8e-4b04-9364-758010c7006b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:55.027369 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f070e965-9f8e-4b04-9364-758010c7006b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:55.034412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f070e965-9f8e-4b04-9364-758010c7006b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:55.034877 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f070e965-9f8e-4b04-9364-758010c7006b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:55.035330 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f070e965-9f8e-4b04-9364-758010c7006b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:55.036023 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f070e965-9f8e-4b04-9364-758010c7006b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:55.036471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f070e965-9f8e-4b04-9364-758010c7006b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:55.036921 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f070e965-9f8e-4b04-9364-758010c7006b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:55.170431 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f070e965-9f8e-4b04-9364-758010c7006b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:55.182847 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f070e965-9f8e-4b04-9364-758010c7006b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1723 microversion: 2.1 time: 0.159744 Aug 28 10:20:55.183613 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 295/573] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:55 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:56.207927 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-45fede86-ff2a-4ef5-972e-c90d401d8f8a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:56.209079 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-45fede86-ff2a-4ef5-972e-c90d401d8f8a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:56.217271 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-45fede86-ff2a-4ef5-972e-c90d401d8f8a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:56.217804 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-45fede86-ff2a-4ef5-972e-c90d401d8f8a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:56.218224 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-45fede86-ff2a-4ef5-972e-c90d401d8f8a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:56.218918 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-45fede86-ff2a-4ef5-972e-c90d401d8f8a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:56.219355 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-45fede86-ff2a-4ef5-972e-c90d401d8f8a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:56.219815 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-45fede86-ff2a-4ef5-972e-c90d401d8f8a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:56.346110 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-45fede86-ff2a-4ef5-972e-c90d401d8f8a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:56.354683 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-45fede86-ff2a-4ef5-972e-c90d401d8f8a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1723 microversion: 2.1 time: 0.153279 Aug 28 10:20:56.355252 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 279/574] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:56 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:57.375375 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-12c3699d-aae7-4369-a400-936bc3cd3a7a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:57.375962 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-12c3699d-aae7-4369-a400-936bc3cd3a7a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:57.378978 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 28 10:20:57.379152 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Sun Aug 28 10:20:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f (ip 10.222.0.40) !!! Aug 28 10:20:57.391286 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12c3699d-aae7-4369-a400-936bc3cd3a7a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:57.391766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12c3699d-aae7-4369-a400-936bc3cd3a7a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:57.392188 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12c3699d-aae7-4369-a400-936bc3cd3a7a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:57.392910 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12c3699d-aae7-4369-a400-936bc3cd3a7a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:57.393351 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12c3699d-aae7-4369-a400-936bc3cd3a7a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:57.393758 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12c3699d-aae7-4369-a400-936bc3cd3a7a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:57.526842 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-12c3699d-aae7-4369-a400-936bc3cd3a7a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:57.535030 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-12c3699d-aae7-4369-a400-936bc3cd3a7a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1723 microversion: 2.1 time: 0.163553 Aug 28 10:20:57.535602 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 296/575] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:57 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:58.559702 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-7069b81f-f01e-4c6d-8d37-8f0b42ff7ed1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:58.561439 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-7069b81f-f01e-4c6d-8d37-8f0b42ff7ed1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:58.568973 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7069b81f-f01e-4c6d-8d37-8f0b42ff7ed1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:58.569626 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7069b81f-f01e-4c6d-8d37-8f0b42ff7ed1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:58.570058 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7069b81f-f01e-4c6d-8d37-8f0b42ff7ed1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:58.570790 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7069b81f-f01e-4c6d-8d37-8f0b42ff7ed1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:58.571242 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7069b81f-f01e-4c6d-8d37-8f0b42ff7ed1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:58.571683 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7069b81f-f01e-4c6d-8d37-8f0b42ff7ed1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:58.715650 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7069b81f-f01e-4c6d-8d37-8f0b42ff7ed1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:58.725472 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-7069b81f-f01e-4c6d-8d37-8f0b42ff7ed1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1723 microversion: 2.1 time: 0.173222 Aug 28 10:20:58.726239 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 280/576] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:58 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:20:59.749327 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fdc5e4c8-2959-4081-b592-586de6504a20 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:20:59.749913 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fdc5e4c8-2959-4081-b592-586de6504a20 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:20:59.756563 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fdc5e4c8-2959-4081-b592-586de6504a20 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:59.757184 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fdc5e4c8-2959-4081-b592-586de6504a20 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:59.757493 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fdc5e4c8-2959-4081-b592-586de6504a20 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:59.758153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fdc5e4c8-2959-4081-b592-586de6504a20 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:20:59.758603 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fdc5e4c8-2959-4081-b592-586de6504a20 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:20:59.759020 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fdc5e4c8-2959-4081-b592-586de6504a20 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:20:59.905583 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fdc5e4c8-2959-4081-b592-586de6504a20 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:20:59.918464 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fdc5e4c8-2959-4081-b592-586de6504a20 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1723 microversion: 2.1 time: 0.173752 Aug 28 10:20:59.919053 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 297/577] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:20:59 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:00.943771 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-aef78609-f03c-4290-8d3d-354fdf16020f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:00.944850 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-aef78609-f03c-4290-8d3d-354fdf16020f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:00.956291 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aef78609-f03c-4290-8d3d-354fdf16020f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:00.957126 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aef78609-f03c-4290-8d3d-354fdf16020f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:00.957828 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aef78609-f03c-4290-8d3d-354fdf16020f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:00.958946 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aef78609-f03c-4290-8d3d-354fdf16020f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:00.959683 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aef78609-f03c-4290-8d3d-354fdf16020f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:00.960369 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aef78609-f03c-4290-8d3d-354fdf16020f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:01.097430 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-aef78609-f03c-4290-8d3d-354fdf16020f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:01.110147 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-aef78609-f03c-4290-8d3d-354fdf16020f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1723 microversion: 2.1 time: 0.172720 Aug 28 10:21:01.110720 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 281/578] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:00 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:02.135673 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-214b51fd-53ca-46e5-b6b4-8fd91775b140 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:02.136666 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-214b51fd-53ca-46e5-b6b4-8fd91775b140 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:02.147248 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-214b51fd-53ca-46e5-b6b4-8fd91775b140 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:02.148059 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-214b51fd-53ca-46e5-b6b4-8fd91775b140 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:02.148857 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-214b51fd-53ca-46e5-b6b4-8fd91775b140 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:02.150250 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-214b51fd-53ca-46e5-b6b4-8fd91775b140 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:02.151108 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-214b51fd-53ca-46e5-b6b4-8fd91775b140 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:02.151865 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-214b51fd-53ca-46e5-b6b4-8fd91775b140 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:02.282130 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-214b51fd-53ca-46e5-b6b4-8fd91775b140 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:02.295301 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-214b51fd-53ca-46e5-b6b4-8fd91775b140 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1723 microversion: 2.1 time: 0.166147 Aug 28 10:21:02.296101 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 298/579] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:02 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:03.325732 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-53765ca4-d9d1-4fb9-bac4-ffbc22fc4ff3 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:03.326697 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-53765ca4-d9d1-4fb9-bac4-ffbc22fc4ff3 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:03.337736 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-53765ca4-d9d1-4fb9-bac4-ffbc22fc4ff3 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:03.338519 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-53765ca4-d9d1-4fb9-bac4-ffbc22fc4ff3 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:03.339219 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-53765ca4-d9d1-4fb9-bac4-ffbc22fc4ff3 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:03.340280 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-53765ca4-d9d1-4fb9-bac4-ffbc22fc4ff3 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:03.340805 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-53765ca4-d9d1-4fb9-bac4-ffbc22fc4ff3 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:03.341162 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-53765ca4-d9d1-4fb9-bac4-ffbc22fc4ff3 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:03.483104 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-53765ca4-d9d1-4fb9-bac4-ffbc22fc4ff3 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:03.491909 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-53765ca4-d9d1-4fb9-bac4-ffbc22fc4ff3 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1723 microversion: 2.1 time: 0.172872 Aug 28 10:21:03.492480 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 282/580] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:03 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:04.517113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-64429af5-0857-4065-a053-ac3bfaf2b194 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:04.518133 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-64429af5-0857-4065-a053-ac3bfaf2b194 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:04.528970 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64429af5-0857-4065-a053-ac3bfaf2b194 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:04.529753 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64429af5-0857-4065-a053-ac3bfaf2b194 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:04.530450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64429af5-0857-4065-a053-ac3bfaf2b194 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:04.531672 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64429af5-0857-4065-a053-ac3bfaf2b194 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:04.532432 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64429af5-0857-4065-a053-ac3bfaf2b194 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:04.533179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64429af5-0857-4065-a053-ac3bfaf2b194 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:04.667973 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-64429af5-0857-4065-a053-ac3bfaf2b194 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:04.677130 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-64429af5-0857-4065-a053-ac3bfaf2b194 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1723 microversion: 2.1 time: 0.166613 Aug 28 10:21:04.677692 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 299/581] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:04 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:05.702130 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-6bbdff70-85d7-4d67-b3b5-84c38d98b155 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:05.703124 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-6bbdff70-85d7-4d67-b3b5-84c38d98b155 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:05.714183 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6bbdff70-85d7-4d67-b3b5-84c38d98b155 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:05.714979 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6bbdff70-85d7-4d67-b3b5-84c38d98b155 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:05.715662 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6bbdff70-85d7-4d67-b3b5-84c38d98b155 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:05.716709 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6bbdff70-85d7-4d67-b3b5-84c38d98b155 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:05.717160 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6bbdff70-85d7-4d67-b3b5-84c38d98b155 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:05.717584 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6bbdff70-85d7-4d67-b3b5-84c38d98b155 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:05.851791 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-6bbdff70-85d7-4d67-b3b5-84c38d98b155 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:05.861646 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-6bbdff70-85d7-4d67-b3b5-84c38d98b155 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1723 microversion: 2.1 time: 0.166055 Aug 28 10:21:05.862216 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 283/582] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:05 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:06.886381 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-64091be1-ba2b-423a-bd36-b84dc2ee4571 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:06.887329 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-64091be1-ba2b-423a-bd36-b84dc2ee4571 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:06.895679 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64091be1-ba2b-423a-bd36-b84dc2ee4571 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:06.896159 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64091be1-ba2b-423a-bd36-b84dc2ee4571 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:06.896614 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64091be1-ba2b-423a-bd36-b84dc2ee4571 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:06.897294 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64091be1-ba2b-423a-bd36-b84dc2ee4571 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:06.897741 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64091be1-ba2b-423a-bd36-b84dc2ee4571 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:06.898157 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64091be1-ba2b-423a-bd36-b84dc2ee4571 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:07.028442 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-64091be1-ba2b-423a-bd36-b84dc2ee4571 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:07.037089 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-64091be1-ba2b-423a-bd36-b84dc2ee4571 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1723 microversion: 2.1 time: 0.157341 Aug 28 10:21:07.037675 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 300/583] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:06 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:08.062847 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4255045a-5075-484a-b9b8-b96555124266 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:08.063641 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4255045a-5075-484a-b9b8-b96555124266 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:08.072681 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4255045a-5075-484a-b9b8-b96555124266 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:08.073320 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4255045a-5075-484a-b9b8-b96555124266 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:08.073884 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4255045a-5075-484a-b9b8-b96555124266 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:08.074768 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4255045a-5075-484a-b9b8-b96555124266 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:08.075387 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4255045a-5075-484a-b9b8-b96555124266 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:08.075944 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4255045a-5075-484a-b9b8-b96555124266 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:08.216223 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4255045a-5075-484a-b9b8-b96555124266 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:08.224971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4255045a-5075-484a-b9b8-b96555124266 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1700 microversion: 2.1 time: 0.168747 Aug 28 10:21:08.225549 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 284/584] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:08 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1700 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:08.245498 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-39f7717c-af5c-4ee6-b3b7-0e4f41eff29d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:21:08.252545 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39f7717c-af5c-4ee6-b3b7-0e4f41eff29d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:08.253051 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39f7717c-af5c-4ee6-b3b7-0e4f41eff29d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:08.253480 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39f7717c-af5c-4ee6-b3b7-0e4f41eff29d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:08.276757 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-39f7717c-af5c-4ee6-b3b7-0e4f41eff29d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Going to try to start instance {{(pid=120663) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 28 10:21:08.295534 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-ffb5f404-7e51-49a5-a3fa-9a46190eba16 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:08.296039 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-ffb5f404-7e51-49a5-a3fa-9a46190eba16 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:08.301984 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ffb5f404-7e51-49a5-a3fa-9a46190eba16 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:08.302457 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ffb5f404-7e51-49a5-a3fa-9a46190eba16 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:08.302887 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ffb5f404-7e51-49a5-a3fa-9a46190eba16 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:08.303548 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ffb5f404-7e51-49a5-a3fa-9a46190eba16 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:08.303982 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ffb5f404-7e51-49a5-a3fa-9a46190eba16 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:08.304389 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ffb5f404-7e51-49a5-a3fa-9a46190eba16 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:08.325859 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-39f7717c-af5c-4ee6-b3b7-0e4f41eff29d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "POST /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f/action" status: 202 len: 0 microversion: 2.1 time: 0.083912 Aug 28 10:21:08.326404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 301/585] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Aug 28 10:21:08 2022] POST /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:21:08.335009 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b03f28cd-e85d-4d33-bbb5-947c51efa9de tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:08.335718 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b03f28cd-e85d-4d33-bbb5-947c51efa9de tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:08.342002 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b03f28cd-e85d-4d33-bbb5-947c51efa9de tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:08.342366 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b03f28cd-e85d-4d33-bbb5-947c51efa9de tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:08.342943 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b03f28cd-e85d-4d33-bbb5-947c51efa9de tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:08.343520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b03f28cd-e85d-4d33-bbb5-947c51efa9de tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:08.343996 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b03f28cd-e85d-4d33-bbb5-947c51efa9de tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:08.344654 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b03f28cd-e85d-4d33-bbb5-947c51efa9de tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:08.440581 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.objects.instance [None req-ffb5f404-7e51-49a5-a3fa-9a46190eba16 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lazy-loading 'services' on Instance uuid 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 {{(pid=120664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:21:08.480717 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b03f28cd-e85d-4d33-bbb5-947c51efa9de tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:08.490281 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b03f28cd-e85d-4d33-bbb5-947c51efa9de tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1709 microversion: 2.1 time: 0.159420 Aug 28 10:21:08.490862 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 302/586] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:08 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1709 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:21:08.563541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-ffb5f404-7e51-49a5-a3fa-9a46190eba16 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5/os-volume_attachments/45278489-820c-4cfe-9bdc-e370a1b1af0e" status: 202 len: 0 microversion: 2.1 time: 0.271792 Aug 28 10:21:08.564335 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 285/587] 10.222.0.40 () {58 vars in 1416 bytes} [Sun Aug 28 10:21:08 2022] DELETE /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5/os-volume_attachments/45278489-820c-4cfe-9bdc-e370a1b1af0e => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 28 10:21:09.511478 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3603ab06-2c64-484a-becf-b54daee99ad5 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:09.512033 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3603ab06-2c64-484a-becf-b54daee99ad5 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:09.519617 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3603ab06-2c64-484a-becf-b54daee99ad5 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:09.520103 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3603ab06-2c64-484a-becf-b54daee99ad5 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:09.520589 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3603ab06-2c64-484a-becf-b54daee99ad5 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:09.521301 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3603ab06-2c64-484a-becf-b54daee99ad5 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:09.521748 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3603ab06-2c64-484a-becf-b54daee99ad5 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:09.522162 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3603ab06-2c64-484a-becf-b54daee99ad5 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:09.655317 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3603ab06-2c64-484a-becf-b54daee99ad5 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:09.664366 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3603ab06-2c64-484a-becf-b54daee99ad5 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1709 microversion: 2.1 time: 0.156899 Aug 28 10:21:09.665099 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 303/588] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:09 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1709 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:10.688404 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8f4e53b1-ae68-4367-85b7-89358a82b7bb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:10.689138 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-8f4e53b1-ae68-4367-85b7-89358a82b7bb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:10.698223 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8f4e53b1-ae68-4367-85b7-89358a82b7bb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:10.698730 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8f4e53b1-ae68-4367-85b7-89358a82b7bb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:10.699053 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8f4e53b1-ae68-4367-85b7-89358a82b7bb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:10.699742 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8f4e53b1-ae68-4367-85b7-89358a82b7bb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:10.700185 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8f4e53b1-ae68-4367-85b7-89358a82b7bb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:10.700640 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8f4e53b1-ae68-4367-85b7-89358a82b7bb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:10.749363 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c6325ca9-6f00-448b-b76c-951e13c89d72 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:10.749936 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c6325ca9-6f00-448b-b76c-951e13c89d72 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:10.756308 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6325ca9-6f00-448b-b76c-951e13c89d72 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:10.756846 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6325ca9-6f00-448b-b76c-951e13c89d72 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:10.757270 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6325ca9-6f00-448b-b76c-951e13c89d72 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:10.757949 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6325ca9-6f00-448b-b76c-951e13c89d72 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:10.758389 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6325ca9-6f00-448b-b76c-951e13c89d72 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:10.758805 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6325ca9-6f00-448b-b76c-951e13c89d72 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:10.784340 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c6325ca9-6f00-448b-b76c-951e13c89d72 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 28 10:21:10.787302 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:21:10.836320 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8f4e53b1-ae68-4367-85b7-89358a82b7bb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:10.839406 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:21:10.849364 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-8f4e53b1-ae68-4367-85b7-89358a82b7bb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1713 microversion: 2.1 time: 0.166793 Aug 28 10:21:10.850056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 286/589] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:10 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1713 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:10.867595 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c6325ca9-6f00-448b-b76c-951e13c89d72 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 204 len: 0 microversion: 2.1 time: 0.121845 Aug 28 10:21:10.868388 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 304/590] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:21:10 2022] DELETE /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 28 10:21:10.876381 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-690f70dd-35e5-4ae0-a180-4bef46b5b357 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:10.877151 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-690f70dd-35e5-4ae0-a180-4bef46b5b357 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:10.883469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-690f70dd-35e5-4ae0-a180-4bef46b5b357 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:10.883947 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-690f70dd-35e5-4ae0-a180-4bef46b5b357 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:10.884377 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-690f70dd-35e5-4ae0-a180-4bef46b5b357 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:10.885087 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-690f70dd-35e5-4ae0-a180-4bef46b5b357 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:10.885533 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-690f70dd-35e5-4ae0-a180-4bef46b5b357 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:10.885948 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-690f70dd-35e5-4ae0-a180-4bef46b5b357 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:11.016495 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-690f70dd-35e5-4ae0-a180-4bef46b5b357 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:11.024353 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-690f70dd-35e5-4ae0-a180-4bef46b5b357 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1513 microversion: 2.1 time: 0.151782 Aug 28 10:21:11.025342 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 287/591] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:10 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:12.050964 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ffcdfceb-2f3e-4ae1-be0c-54c277f8a399 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:12.052118 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ffcdfceb-2f3e-4ae1-be0c-54c277f8a399 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:12.062980 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ffcdfceb-2f3e-4ae1-be0c-54c277f8a399 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:12.063767 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ffcdfceb-2f3e-4ae1-be0c-54c277f8a399 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:12.064410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ffcdfceb-2f3e-4ae1-be0c-54c277f8a399 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:12.065130 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ffcdfceb-2f3e-4ae1-be0c-54c277f8a399 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:12.065574 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ffcdfceb-2f3e-4ae1-be0c-54c277f8a399 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:12.065997 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ffcdfceb-2f3e-4ae1-be0c-54c277f8a399 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:12.201729 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ffcdfceb-2f3e-4ae1-be0c-54c277f8a399 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:12.209587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ffcdfceb-2f3e-4ae1-be0c-54c277f8a399 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1513 microversion: 2.1 time: 0.165755 Aug 28 10:21:12.210175 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 305/592] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:12 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:13.232733 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-d780eb93-59fc-4c88-b7ee-fc8f2ec491fa tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:13.233319 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-d780eb93-59fc-4c88-b7ee-fc8f2ec491fa tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:13.241142 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d780eb93-59fc-4c88-b7ee-fc8f2ec491fa tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:13.241615 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d780eb93-59fc-4c88-b7ee-fc8f2ec491fa tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:13.242036 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d780eb93-59fc-4c88-b7ee-fc8f2ec491fa tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:13.242718 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d780eb93-59fc-4c88-b7ee-fc8f2ec491fa tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:13.243152 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d780eb93-59fc-4c88-b7ee-fc8f2ec491fa tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:13.243560 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d780eb93-59fc-4c88-b7ee-fc8f2ec491fa tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:13.371644 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d780eb93-59fc-4c88-b7ee-fc8f2ec491fa tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:13.379953 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-d780eb93-59fc-4c88-b7ee-fc8f2ec491fa tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1513 microversion: 2.1 time: 0.153099 Aug 28 10:21:13.380548 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 288/593] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:13 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:13.623175 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-b32cf508-515e-4427-902b-c4d8e33ef845 req-ff19bb79-f1ac-4e2c-b470-05e138dd05cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2395cb9a-a58f-4b70-ae5b-d6a8c50defd5", "name": "network-vif-deleted", "tag": "91385417-fe64-4627-8e5b-26521bfffb9f"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:21:13.633910 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-b32cf508-515e-4427-902b-c4d8e33ef845 req-ff19bb79-f1ac-4e2c-b470-05e138dd05cc service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:13.634376 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-b32cf508-515e-4427-902b-c4d8e33ef845 req-ff19bb79-f1ac-4e2c-b470-05e138dd05cc service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:13.634773 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-b32cf508-515e-4427-902b-c4d8e33ef845 req-ff19bb79-f1ac-4e2c-b470-05e138dd05cc service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:13.646976 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-b32cf508-515e-4427-902b-c4d8e33ef845 req-ff19bb79-f1ac-4e2c-b470-05e138dd05cc service nova] Creating event network-vif-deleted:91385417-fe64-4627-8e5b-26521bfffb9f for instance 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 on hv-cinder-85200 Aug 28 10:21:13.651931 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-b32cf508-515e-4427-902b-c4d8e33ef845 req-ff19bb79-f1ac-4e2c-b470-05e138dd05cc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032537 Aug 28 10:21:13.652804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 306/594] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:21:14.400791 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f64de87a-e343-482b-8e63-095cae0eecbe tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:14.401430 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f64de87a-e343-482b-8e63-095cae0eecbe tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:14.403817 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=36 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:21:14.409243 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f64de87a-e343-482b-8e63-095cae0eecbe tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:14.409717 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f64de87a-e343-482b-8e63-095cae0eecbe tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:14.410138 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f64de87a-e343-482b-8e63-095cae0eecbe tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:14.410850 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f64de87a-e343-482b-8e63-095cae0eecbe tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:14.411268 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f64de87a-e343-482b-8e63-095cae0eecbe tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:14.411675 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f64de87a-e343-482b-8e63-095cae0eecbe tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:14.447506 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f64de87a-e343-482b-8e63-095cae0eecbe tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:14.448074 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f64de87a-e343-482b-8e63-095cae0eecbe tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:14.448492 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f64de87a-e343-482b-8e63-095cae0eecbe tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:14.448923 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.objects.instance [None req-f64de87a-e343-482b-8e63-095cae0eecbe tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lazy-loading 'fault' on Instance uuid 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 {{(pid=120664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:21:14.492083 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f64de87a-e343-482b-8e63-095cae0eecbe tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b5483267549e6be369a653928b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4f12270d54d5784bb9a12aced18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:14.499213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f64de87a-e343-482b-8e63-095cae0eecbe tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 200 len: 1307 microversion: 2.1 time: 0.102329 Aug 28 10:21:14.499747 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 289/595] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:14 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:15.525067 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a0649960-e4ae-4c23-a29e-4650a1391ba9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:15.525989 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a0649960-e4ae-4c23-a29e-4650a1391ba9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] [instance: 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:15.536524 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a0649960-e4ae-4c23-a29e-4650a1391ba9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:15.537005 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a0649960-e4ae-4c23-a29e-4650a1391ba9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:15.537435 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a0649960-e4ae-4c23-a29e-4650a1391ba9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:15.538118 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a0649960-e4ae-4c23-a29e-4650a1391ba9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:15.538559 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a0649960-e4ae-4c23-a29e-4650a1391ba9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:15.538973 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a0649960-e4ae-4c23-a29e-4650a1391ba9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:15.552890 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-a0649960-e4ae-4c23-a29e-4650a1391ba9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] HTTP exception thrown: Instance 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 could not be found. Aug 28 10:21:15.554516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a0649960-e4ae-4c23-a29e-4650a1391ba9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Request method failure captured: Aug 28 10:21:15.554516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 HTTP/1.1 Aug 28 10:21:15.554516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:21:15.554516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:21:15.554516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:21:15.554516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:21:15.554516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:21:15.554516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:21:15.554516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:21:15.554516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:21:15.554516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0DtzJxoOOP7G3JW6cwenUBOj2WcPmsG_7nh-ePGwWMXyp2WXR4pDXizUpoquyPp7DINX1QP0rlchuPg5oyuZbyX8-1CwdSisRNEvOfQ9eFlEvt5DEQKV8vxYree7IH9fsMKo8edOBAA5ObKdDGCZ_Xn1m8bD96sS3Zkx5mJHcf3MlU Aug 28 10:21:15.554516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:21:15.554516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:21:15.554516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:21:15.554516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:21:15.554516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:21:15.554516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:21:15.554516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 04c4f12270d54d5784bb9a12aced18c2 Aug 28 10:21:15.554516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesSnapshotTestJSON-863429265 Aug 28 10:21:15.554516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:21:15.554516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:21:15.555904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_04c4f12270d54d5784bb9a12aced18c2", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/04c4f12270d54d5784bb9a12aced18c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/04c4f12270d54d5784bb9a12aced18c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/04c4f12270d54d5784bb9a12aced18c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:21:15.555904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesSnapshotTestJSON-863429265 Aug 28 10:21:15.555904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 04c4f12270d54d5784bb9a12aced18c2 Aug 28 10:21:15.555904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-863429265 Aug 28 10:21:15.555904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesSnapshotTestJSON-863429265-project Aug 28 10:21:15.555904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:21:15.555904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:21:15.555904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: 538b5483267549e6be369a653928b4b9 Aug 28 10:21:15.555904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesSnapshotTestJSON-863429265-project Aug 28 10:21:15.555904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: > Aug 28 10:21:15.555904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Instance 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 could not be found. Aug 28 10:21:15.555904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '2395cb9a-a58f-4b70-ae5b-d6a8c50defd5'} Aug 28 10:21:15.556674 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:21:15.556674 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:21:15.556674 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:21:15.556674 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:21:15.556674 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:21:15.556674 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:21:15.556674 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:21:15.556674 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:21:15.556674 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:21:15.556674 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:21:15.556674 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 could not be found. Aug 28 10:21:15.556674 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:21:15.556674 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:21:15.556674 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:21:15.556674 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:21:15.556674 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:21:15.556674 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:21:15.556674 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:21:15.556674 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:21:15.556674 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:21:15.558128 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:21:15.558128 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:21:15.558128 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:21:15.558128 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:21:15.558128 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:21:15.558128 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:21:15.558128 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:21:15.558128 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 could not be found. Aug 28 10:21:15.558128 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:21:15.558128 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:21:15.558128 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:21:15.558128 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:21:15.558128 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:21:15.558128 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:21:15.558128 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:21:15.558128 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:21:15.558128 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 could not be found. Aug 28 10:21:15.558128 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:21:15.559399 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a0649960-e4ae-4c23-a29e-4650a1391ba9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] Returning 404 to user: Instance 2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:21:15.559399 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a0649960-e4ae-4c23-a29e-4650a1391ba9 tempest-VolumesSnapshotTestJSON-863429265 tempest-VolumesSnapshotTestJSON-863429265-project] 10.222.0.40 "GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5" status: 404 len: 111 microversion: 2.1 time: 0.038238 Aug 28 10:21:15.559399 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 307/596] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:15 2022] GET /compute/v2.1/servers/2395cb9a-a58f-4b70-ae5b-d6a8c50defd5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:21:28.028491 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=3 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:21:28.029684 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=21 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:21:28.097407 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-fa655590-dec0-4548-8ae3-20be5441ed97 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55a867c7-4149-45b3-95d5-8c95e39153b8"}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:21:28.099831 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-fa655590-dec0-4548-8ae3-20be5441ed97 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:28.105910 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fa655590-dec0-4548-8ae3-20be5441ed97 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:28.106397 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fa655590-dec0-4548-8ae3-20be5441ed97 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:28.106824 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fa655590-dec0-4548-8ae3-20be5441ed97 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:28.107511 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fa655590-dec0-4548-8ae3-20be5441ed97 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:28.107952 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fa655590-dec0-4548-8ae3-20be5441ed97 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:28.108369 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fa655590-dec0-4548-8ae3-20be5441ed97 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:30.607088 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-fa655590-dec0-4548-8ae3-20be5441ed97 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "POST /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.587102 Aug 28 10:21:30.607710 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 290/597] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Aug 28 10:21:28 2022] POST /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990/os-volume_attachments => generated 194 bytes in 2589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:21:38.228907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-11ebd14c-8849-4837-a153-75c26305796f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:21:38.231201 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-11ebd14c-8849-4837-a153-75c26305796f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:38.233623 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:21:38.234266 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:21:38.240830 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11ebd14c-8849-4837-a153-75c26305796f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:38.241368 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11ebd14c-8849-4837-a153-75c26305796f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:38.241798 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11ebd14c-8849-4837-a153-75c26305796f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:38.242484 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11ebd14c-8849-4837-a153-75c26305796f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:38.242924 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11ebd14c-8849-4837-a153-75c26305796f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:38.243343 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11ebd14c-8849-4837-a153-75c26305796f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:38.267845 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-11ebd14c-8849-4837-a153-75c26305796f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lazy-loading 'flavor' on Instance uuid c652c0fc-a515-4755-9eb4-8d46727fe990 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:21:38.394766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-11ebd14c-8849-4837-a153-75c26305796f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "POST /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990/action" status: 200 len: 32 microversion: 2.1 time: 0.169860 Aug 28 10:21:38.395605 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 308/598] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Aug 28 10:21:38 2022] POST /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 28 10:21:38.403124 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=2 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:21:38.407403 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-be50bccb-adce-4c66-a4ea-614bb0e0b83f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:38.408165 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-be50bccb-adce-4c66-a4ea-614bb0e0b83f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:38.415025 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-be50bccb-adce-4c66-a4ea-614bb0e0b83f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:38.415603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-be50bccb-adce-4c66-a4ea-614bb0e0b83f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:38.416439 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-be50bccb-adce-4c66-a4ea-614bb0e0b83f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:38.417200 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-be50bccb-adce-4c66-a4ea-614bb0e0b83f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:38.417680 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-be50bccb-adce-4c66-a4ea-614bb0e0b83f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:38.418103 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-be50bccb-adce-4c66-a4ea-614bb0e0b83f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:38.551398 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-be50bccb-adce-4c66-a4ea-614bb0e0b83f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:38.560223 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-be50bccb-adce-4c66-a4ea-614bb0e0b83f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1735 microversion: 2.1 time: 0.158802 Aug 28 10:21:38.560809 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 291/599] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:38 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:39.585428 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1527e6f7-a84b-4423-a150-2bbedfa1db2b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:39.586131 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1527e6f7-a84b-4423-a150-2bbedfa1db2b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:39.593200 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1527e6f7-a84b-4423-a150-2bbedfa1db2b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:39.593681 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1527e6f7-a84b-4423-a150-2bbedfa1db2b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:39.594117 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1527e6f7-a84b-4423-a150-2bbedfa1db2b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:39.594809 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1527e6f7-a84b-4423-a150-2bbedfa1db2b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:39.595258 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1527e6f7-a84b-4423-a150-2bbedfa1db2b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:39.595679 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1527e6f7-a84b-4423-a150-2bbedfa1db2b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:39.734419 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1527e6f7-a84b-4423-a150-2bbedfa1db2b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:39.743629 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1527e6f7-a84b-4423-a150-2bbedfa1db2b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1735 microversion: 2.1 time: 0.164790 Aug 28 10:21:39.744202 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 309/600] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:39 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:40.769152 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-da1f44bd-0f1d-43a0-ae1c-0b279c3a3450 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:40.769977 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-da1f44bd-0f1d-43a0-ae1c-0b279c3a3450 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:40.779572 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-da1f44bd-0f1d-43a0-ae1c-0b279c3a3450 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:40.780044 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-da1f44bd-0f1d-43a0-ae1c-0b279c3a3450 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:40.780470 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-da1f44bd-0f1d-43a0-ae1c-0b279c3a3450 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:40.781175 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-da1f44bd-0f1d-43a0-ae1c-0b279c3a3450 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:40.781615 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-da1f44bd-0f1d-43a0-ae1c-0b279c3a3450 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:40.782006 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-da1f44bd-0f1d-43a0-ae1c-0b279c3a3450 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:40.918066 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-da1f44bd-0f1d-43a0-ae1c-0b279c3a3450 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:40.926765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-da1f44bd-0f1d-43a0-ae1c-0b279c3a3450 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1735 microversion: 2.1 time: 0.164326 Aug 28 10:21:40.927361 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 292/601] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:40 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:41.947548 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5684cf18-9af8-4359-ad1c-4931ed8a460b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:41.948068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5684cf18-9af8-4359-ad1c-4931ed8a460b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:41.954627 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5684cf18-9af8-4359-ad1c-4931ed8a460b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:41.955080 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5684cf18-9af8-4359-ad1c-4931ed8a460b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:41.955534 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5684cf18-9af8-4359-ad1c-4931ed8a460b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:41.956220 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5684cf18-9af8-4359-ad1c-4931ed8a460b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:41.956700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5684cf18-9af8-4359-ad1c-4931ed8a460b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:41.957117 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5684cf18-9af8-4359-ad1c-4931ed8a460b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:42.101644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5684cf18-9af8-4359-ad1c-4931ed8a460b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:42.110232 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5684cf18-9af8-4359-ad1c-4931ed8a460b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1735 microversion: 2.1 time: 0.166747 Aug 28 10:21:42.110943 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 310/602] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:41 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:43.131849 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-148c1500-d27e-4a3f-8311-02ca969c0758 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:43.132576 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-148c1500-d27e-4a3f-8311-02ca969c0758 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:43.139796 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-148c1500-d27e-4a3f-8311-02ca969c0758 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:43.140340 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-148c1500-d27e-4a3f-8311-02ca969c0758 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:43.140874 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-148c1500-d27e-4a3f-8311-02ca969c0758 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:43.141628 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-148c1500-d27e-4a3f-8311-02ca969c0758 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:43.142139 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-148c1500-d27e-4a3f-8311-02ca969c0758 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:43.142613 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-148c1500-d27e-4a3f-8311-02ca969c0758 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:43.277110 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-148c1500-d27e-4a3f-8311-02ca969c0758 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:43.287683 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-148c1500-d27e-4a3f-8311-02ca969c0758 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1735 microversion: 2.1 time: 0.159933 Aug 28 10:21:43.288596 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 293/603] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:43 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:44.309542 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5b99e5f2-1471-4321-b3b6-e60862cd6655 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:44.310324 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5b99e5f2-1471-4321-b3b6-e60862cd6655 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:44.317153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5b99e5f2-1471-4321-b3b6-e60862cd6655 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:44.317605 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5b99e5f2-1471-4321-b3b6-e60862cd6655 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:44.318040 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5b99e5f2-1471-4321-b3b6-e60862cd6655 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:44.318736 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5b99e5f2-1471-4321-b3b6-e60862cd6655 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:44.319187 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5b99e5f2-1471-4321-b3b6-e60862cd6655 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:44.319601 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5b99e5f2-1471-4321-b3b6-e60862cd6655 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:44.457283 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5b99e5f2-1471-4321-b3b6-e60862cd6655 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:44.465571 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5b99e5f2-1471-4321-b3b6-e60862cd6655 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1735 microversion: 2.1 time: 0.159929 Aug 28 10:21:44.466140 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 311/604] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:44 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:45.487981 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-9a69a0a3-d20b-4e2f-b3be-75b84455d80e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:45.488829 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-9a69a0a3-d20b-4e2f-b3be-75b84455d80e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:45.497649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9a69a0a3-d20b-4e2f-b3be-75b84455d80e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:45.498312 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9a69a0a3-d20b-4e2f-b3be-75b84455d80e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:45.498963 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9a69a0a3-d20b-4e2f-b3be-75b84455d80e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:45.499872 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9a69a0a3-d20b-4e2f-b3be-75b84455d80e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:45.500466 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9a69a0a3-d20b-4e2f-b3be-75b84455d80e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:45.501060 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9a69a0a3-d20b-4e2f-b3be-75b84455d80e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:45.646570 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-9a69a0a3-d20b-4e2f-b3be-75b84455d80e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:45.658285 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-9a69a0a3-d20b-4e2f-b3be-75b84455d80e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1735 microversion: 2.1 time: 0.175363 Aug 28 10:21:45.658861 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 294/605] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:45 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:46.683528 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-73e222bf-e18a-41c4-bc9d-5070b31b5b86 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:46.684633 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-73e222bf-e18a-41c4-bc9d-5070b31b5b86 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:46.692773 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-73e222bf-e18a-41c4-bc9d-5070b31b5b86 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:46.693365 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-73e222bf-e18a-41c4-bc9d-5070b31b5b86 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:46.693795 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-73e222bf-e18a-41c4-bc9d-5070b31b5b86 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:46.694477 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-73e222bf-e18a-41c4-bc9d-5070b31b5b86 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:46.694917 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-73e222bf-e18a-41c4-bc9d-5070b31b5b86 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:46.695328 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-73e222bf-e18a-41c4-bc9d-5070b31b5b86 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:46.833728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-73e222bf-e18a-41c4-bc9d-5070b31b5b86 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:46.842108 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-73e222bf-e18a-41c4-bc9d-5070b31b5b86 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1735 microversion: 2.1 time: 0.165198 Aug 28 10:21:46.842748 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 312/606] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:46 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:47.866542 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-72fbdc25-e3c4-4fb0-892b-e936c386399b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:47.867142 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-72fbdc25-e3c4-4fb0-892b-e936c386399b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:47.877150 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-72fbdc25-e3c4-4fb0-892b-e936c386399b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:47.877630 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-72fbdc25-e3c4-4fb0-892b-e936c386399b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:47.878053 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-72fbdc25-e3c4-4fb0-892b-e936c386399b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:47.878740 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-72fbdc25-e3c4-4fb0-892b-e936c386399b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:47.879188 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-72fbdc25-e3c4-4fb0-892b-e936c386399b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:47.879601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-72fbdc25-e3c4-4fb0-892b-e936c386399b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:48.006119 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-72fbdc25-e3c4-4fb0-892b-e936c386399b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:48.014620 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-72fbdc25-e3c4-4fb0-892b-e936c386399b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1735 microversion: 2.1 time: 0.154555 Aug 28 10:21:48.015219 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 295/607] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:47 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:49.046796 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9e1db2ee-fabc-4d59-b516-de5ae17b39f0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:49.047942 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9e1db2ee-fabc-4d59-b516-de5ae17b39f0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:49.055709 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e1db2ee-fabc-4d59-b516-de5ae17b39f0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:49.056240 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e1db2ee-fabc-4d59-b516-de5ae17b39f0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:49.056849 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e1db2ee-fabc-4d59-b516-de5ae17b39f0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:49.057617 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e1db2ee-fabc-4d59-b516-de5ae17b39f0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:49.058113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e1db2ee-fabc-4d59-b516-de5ae17b39f0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:49.058578 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e1db2ee-fabc-4d59-b516-de5ae17b39f0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:49.192676 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9e1db2ee-fabc-4d59-b516-de5ae17b39f0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:49.201135 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9e1db2ee-fabc-4d59-b516-de5ae17b39f0 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1735 microversion: 2.1 time: 0.161367 Aug 28 10:21:49.201706 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 313/608] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:49 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:50.226523 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-80508b1c-332d-4efb-8016-7d18c8501901 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:50.227425 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-80508b1c-332d-4efb-8016-7d18c8501901 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:50.238504 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-80508b1c-332d-4efb-8016-7d18c8501901 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:50.239292 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-80508b1c-332d-4efb-8016-7d18c8501901 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:50.240062 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-80508b1c-332d-4efb-8016-7d18c8501901 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:50.241242 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-80508b1c-332d-4efb-8016-7d18c8501901 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:50.241995 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-80508b1c-332d-4efb-8016-7d18c8501901 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:50.242748 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-80508b1c-332d-4efb-8016-7d18c8501901 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:50.381680 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-80508b1c-332d-4efb-8016-7d18c8501901 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:50.390154 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-80508b1c-332d-4efb-8016-7d18c8501901 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1735 microversion: 2.1 time: 0.170183 Aug 28 10:21:50.390725 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 296/609] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:50 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:51.417420 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2f47448d-c645-4d07-8414-bb9afd2170d1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:51.418008 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2f47448d-c645-4d07-8414-bb9afd2170d1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:51.425084 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2f47448d-c645-4d07-8414-bb9afd2170d1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:51.425614 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2f47448d-c645-4d07-8414-bb9afd2170d1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:51.426040 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2f47448d-c645-4d07-8414-bb9afd2170d1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:51.426725 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2f47448d-c645-4d07-8414-bb9afd2170d1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:51.427185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2f47448d-c645-4d07-8414-bb9afd2170d1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:51.427592 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2f47448d-c645-4d07-8414-bb9afd2170d1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:51.570054 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2f47448d-c645-4d07-8414-bb9afd2170d1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:51.581239 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2f47448d-c645-4d07-8414-bb9afd2170d1 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1735 microversion: 2.1 time: 0.168016 Aug 28 10:21:51.581753 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 314/610] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:51 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:52.606014 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c2eba193-068f-4062-a926-bd30be2f54a7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:52.606618 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c2eba193-068f-4062-a926-bd30be2f54a7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:52.613661 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c2eba193-068f-4062-a926-bd30be2f54a7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:52.614135 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c2eba193-068f-4062-a926-bd30be2f54a7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:52.614548 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c2eba193-068f-4062-a926-bd30be2f54a7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:52.615220 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c2eba193-068f-4062-a926-bd30be2f54a7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:52.615663 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c2eba193-068f-4062-a926-bd30be2f54a7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:52.616104 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c2eba193-068f-4062-a926-bd30be2f54a7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:52.746224 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c2eba193-068f-4062-a926-bd30be2f54a7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:52.758974 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c2eba193-068f-4062-a926-bd30be2f54a7 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1735 microversion: 2.1 time: 0.156707 Aug 28 10:21:52.759707 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 297/611] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:52 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:53.782967 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ac294774-14e4-4b4d-9686-deb99f3b4080 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:53.783535 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ac294774-14e4-4b4d-9686-deb99f3b4080 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:53.790207 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ac294774-14e4-4b4d-9686-deb99f3b4080 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:53.790692 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ac294774-14e4-4b4d-9686-deb99f3b4080 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:53.791456 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ac294774-14e4-4b4d-9686-deb99f3b4080 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:53.792164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ac294774-14e4-4b4d-9686-deb99f3b4080 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:53.792634 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ac294774-14e4-4b4d-9686-deb99f3b4080 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:53.793056 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ac294774-14e4-4b4d-9686-deb99f3b4080 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:53.933972 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ac294774-14e4-4b4d-9686-deb99f3b4080 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:53.942829 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ac294774-14e4-4b4d-9686-deb99f3b4080 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1735 microversion: 2.1 time: 0.163858 Aug 28 10:21:53.943398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 315/612] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:53 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:54.963738 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-09a2dc0c-4877-41aa-b9b2-bb54f6bc6021 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:54.964357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-09a2dc0c-4877-41aa-b9b2-bb54f6bc6021 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:54.971054 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-09a2dc0c-4877-41aa-b9b2-bb54f6bc6021 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:54.971545 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-09a2dc0c-4877-41aa-b9b2-bb54f6bc6021 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:54.972081 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-09a2dc0c-4877-41aa-b9b2-bb54f6bc6021 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:54.972778 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-09a2dc0c-4877-41aa-b9b2-bb54f6bc6021 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:54.973211 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-09a2dc0c-4877-41aa-b9b2-bb54f6bc6021 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:54.973991 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-09a2dc0c-4877-41aa-b9b2-bb54f6bc6021 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:55.125168 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-09a2dc0c-4877-41aa-b9b2-bb54f6bc6021 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:55.133699 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-09a2dc0c-4877-41aa-b9b2-bb54f6bc6021 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1735 microversion: 2.1 time: 0.173745 Aug 28 10:21:55.134269 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 298/613] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:54 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:56.158885 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e603ca00-6364-4319-a2ed-0432c6fac182 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:56.159358 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e603ca00-6364-4319-a2ed-0432c6fac182 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:56.165646 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e603ca00-6364-4319-a2ed-0432c6fac182 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:56.166447 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e603ca00-6364-4319-a2ed-0432c6fac182 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:56.166891 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e603ca00-6364-4319-a2ed-0432c6fac182 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:56.167576 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e603ca00-6364-4319-a2ed-0432c6fac182 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:56.168018 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e603ca00-6364-4319-a2ed-0432c6fac182 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:56.168431 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e603ca00-6364-4319-a2ed-0432c6fac182 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:56.305950 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e603ca00-6364-4319-a2ed-0432c6fac182 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:56.314319 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e603ca00-6364-4319-a2ed-0432c6fac182 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1735 microversion: 2.1 time: 0.162623 Aug 28 10:21:56.314952 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 316/614] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:56 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:57.340109 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-6dfa7666-61c5-49f9-802c-2a7821cedd99 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:57.341097 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-6dfa7666-61c5-49f9-802c-2a7821cedd99 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:57.352040 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6dfa7666-61c5-49f9-802c-2a7821cedd99 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:57.352860 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6dfa7666-61c5-49f9-802c-2a7821cedd99 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:57.353568 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6dfa7666-61c5-49f9-802c-2a7821cedd99 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:57.354693 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6dfa7666-61c5-49f9-802c-2a7821cedd99 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:57.355395 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6dfa7666-61c5-49f9-802c-2a7821cedd99 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:57.356133 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6dfa7666-61c5-49f9-802c-2a7821cedd99 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:57.491017 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-6dfa7666-61c5-49f9-802c-2a7821cedd99 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:57.499953 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-6dfa7666-61c5-49f9-802c-2a7821cedd99 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1735 microversion: 2.1 time: 0.166345 Aug 28 10:21:57.500538 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 299/615] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:57 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:58.524753 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-01efce1f-ead7-48fe-bd25-185239d971bb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:58.525625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-01efce1f-ead7-48fe-bd25-185239d971bb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:58.535699 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01efce1f-ead7-48fe-bd25-185239d971bb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:58.536180 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01efce1f-ead7-48fe-bd25-185239d971bb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:58.536649 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01efce1f-ead7-48fe-bd25-185239d971bb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:58.537321 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01efce1f-ead7-48fe-bd25-185239d971bb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:58.537763 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01efce1f-ead7-48fe-bd25-185239d971bb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:58.538175 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01efce1f-ead7-48fe-bd25-185239d971bb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:58.670421 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-01efce1f-ead7-48fe-bd25-185239d971bb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:58.679263 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-01efce1f-ead7-48fe-bd25-185239d971bb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1735 microversion: 2.1 time: 0.161295 Aug 28 10:21:58.679843 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 317/616] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:58 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:59.705065 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f2480034-e5b1-4067-9766-c3b66085c966 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:59.706411 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f2480034-e5b1-4067-9766-c3b66085c966 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:59.713313 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f2480034-e5b1-4067-9766-c3b66085c966 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:59.713793 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f2480034-e5b1-4067-9766-c3b66085c966 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:59.714218 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f2480034-e5b1-4067-9766-c3b66085c966 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:59.714905 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f2480034-e5b1-4067-9766-c3b66085c966 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:59.715350 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f2480034-e5b1-4067-9766-c3b66085c966 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:59.715762 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f2480034-e5b1-4067-9766-c3b66085c966 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:59.718354 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:21:59.861767 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f2480034-e5b1-4067-9766-c3b66085c966 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:21:59.871843 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f2480034-e5b1-4067-9766-c3b66085c966 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1735 microversion: 2.1 time: 0.173698 Aug 28 10:21:59.872531 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 300/617] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:21:59 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:21:59.956954 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9b17b1d1-e6ba-404e-9262-2a91036a0762 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:21:59.957448 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9b17b1d1-e6ba-404e-9262-2a91036a0762 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:21:59.963404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9b17b1d1-e6ba-404e-9262-2a91036a0762 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:59.963871 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9b17b1d1-e6ba-404e-9262-2a91036a0762 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:59.964288 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9b17b1d1-e6ba-404e-9262-2a91036a0762 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:59.965011 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9b17b1d1-e6ba-404e-9262-2a91036a0762 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:21:59.965449 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9b17b1d1-e6ba-404e-9262-2a91036a0762 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:21:59.965912 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9b17b1d1-e6ba-404e-9262-2a91036a0762 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:21:59.988876 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9b17b1d1-e6ba-404e-9262-2a91036a0762 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709/ips" status: 200 len: 149 microversion: 2.1 time: 0.217349 Aug 28 10:21:59.989422 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 318/618] 10.222.0.40 () {58 vars in 1248 bytes} [Sun Aug 28 10:21:59 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709/ips => generated 149 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:22:00.002309 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-1351106c-afbe-48c6-98a2-e50cce611dbd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6728751-c833-45bd-b37c-2cef24a537d2"}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:22:00.004838 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-1351106c-afbe-48c6-98a2-e50cce611dbd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:00.010977 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1351106c-afbe-48c6-98a2-e50cce611dbd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:00.011460 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1351106c-afbe-48c6-98a2-e50cce611dbd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:00.011891 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1351106c-afbe-48c6-98a2-e50cce611dbd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:00.012567 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1351106c-afbe-48c6-98a2-e50cce611dbd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:00.013013 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1351106c-afbe-48c6-98a2-e50cce611dbd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:00.013431 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1351106c-afbe-48c6-98a2-e50cce611dbd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:00.097668 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-1351106c-afbe-48c6-98a2-e50cce611dbd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] HTTP exception thrown: Invalid volume: volume f6728751-c833-45bd-b37c-2cef24a537d2 is already attached to instances: c41bc126-2936-43a3-a819-e9433bb7f8f4 Aug 28 10:22:00.099512 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-1351106c-afbe-48c6-98a2-e50cce611dbd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Request method failure captured: Aug 28 10:22:00.099512 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: POST /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709/os-volume_attachments HTTP/1.1 Aug 28 10:22:00.099512 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:22:00.099512 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:22:00.099512 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:22:00.099512 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 74 Aug 28 10:22:00.099512 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:22:00.099512 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:22:00.099512 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:22:00.099512 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:22:00.099512 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0BavBPfn9Wuv1kO4_4p6KYI6akLuIPAA1OxoMOfBpiurh2AuIBrDxo6hNz9wgslLyVrLvU5C-5Daa9wSWxwGejTKWsNtPvyULf4-HsU7LK2myKRcFzE4k1R7_TjPnuTN-hG4pARjml16ldcyWGxfFf1ULa1aMpcmJVMbJUsqOVrYCU Aug 28 10:22:00.099512 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:22:00.099512 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:22:00.099512 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:22:00.099512 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:22:00.099512 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:22:00.099512 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:22:00.099512 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:22:00.099512 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:22:00.099512 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:22:00.099512 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:22:00.100999 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_eefcb341ab8d4823a95c5bce47395083", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:22:00.100999 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:22:00.100999 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:22:00.100999 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:22:00.100999 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:22:00.100999 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:22:00.100999 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:22:00.100999 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: ed4711b7691643109007e173fee1c405 Aug 28 10:22:00.100999 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:22:00.100999 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Aug 28 10:22:00.100999 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {"volumeAttachment": {"volumeId": "f6728751-c833-45bd-b37c-2cef24a537d2"}} Aug 28 10:22:00.100999 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: > Aug 28 10:22:00.101901 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Invalid volume: volume f6728751-c833-45bd-b37c-2cef24a537d2 is already attached to instances: c41bc126-2936-43a3-a819-e9433bb7f8f4 Aug 28 10:22:00.101901 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'server_id': '109322c8-1668-4c81-bac7-b05bfacf1709', 'body': {'volumeAttachment': {'volumeId': 'f6728751-c833-45bd-b37c-2cef24a537d2'}}} Aug 28 10:22:00.101901 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:22:00.101901 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:22:00.101901 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 28 10:22:00.101901 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 28 10:22:00.101901 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 28 10:22:00.101901 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 28 10:22:00.101901 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 28 10:22:00.101901 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 28 10:22:00.101901 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 28 10:22:00.101901 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 28 10:22:00.101901 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 28 10:22:00.101901 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 28 10:22:00.101901 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f6728751-c833-45bd-b37c-2cef24a537d2 is already attached to instances: c41bc126-2936-43a3-a819-e9433bb7f8f4 Aug 28 10:22:00.101901 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:22:00.101901 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:22:00.101901 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:22:00.101901 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:22:00.103301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:22:00.103301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:22:00.103301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:22:00.103301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:22:00.103301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:22:00.103301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:22:00.103301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 28 10:22:00.103301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 28 10:22:00.103301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 28 10:22:00.103301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 28 10:22:00.103301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 28 10:22:00.103301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 28 10:22:00.103301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 28 10:22:00.103301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 28 10:22:00.103301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f6728751-c833-45bd-b37c-2cef24a537d2 is already attached to instances: c41bc126-2936-43a3-a819-e9433bb7f8f4 Aug 28 10:22:00.103301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:22:00.103301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:22:00.103301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:22:00.103301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:22:00.103301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:22:00.104492 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:22:00.104492 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:22:00.104492 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:22:00.104492 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f6728751-c833-45bd-b37c-2cef24a537d2 is already attached to instances: c41bc126-2936-43a3-a819-e9433bb7f8f4 Aug 28 10:22:00.104492 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:22:00.104492 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-1351106c-afbe-48c6-98a2-e50cce611dbd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Returning 400 to user: Invalid volume: volume f6728751-c833-45bd-b37c-2cef24a537d2 is already attached to instances: c41bc126-2936-43a3-a819-e9433bb7f8f4 {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:22:00.104492 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-1351106c-afbe-48c6-98a2-e50cce611dbd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "POST /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102893 Aug 28 10:22:00.104492 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 301/619] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Aug 28 10:21:59 2022] POST /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 28 10:22:00.110430 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-96cbec13-1b63-471d-9469-0a0547630d3c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:00.110925 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-96cbec13-1b63-471d-9469-0a0547630d3c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:00.117272 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-96cbec13-1b63-471d-9469-0a0547630d3c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:00.117745 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-96cbec13-1b63-471d-9469-0a0547630d3c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:00.118162 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-96cbec13-1b63-471d-9469-0a0547630d3c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:00.118840 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-96cbec13-1b63-471d-9469-0a0547630d3c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:00.119274 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-96cbec13-1b63-471d-9469-0a0547630d3c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:00.119684 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-96cbec13-1b63-471d-9469-0a0547630d3c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:00.144798 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-96cbec13-1b63-471d-9469-0a0547630d3c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 28 10:22:00.233207 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-96cbec13-1b63-471d-9469-0a0547630d3c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "DELETE /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 204 len: 0 microversion: 2.1 time: 0.125964 Aug 28 10:22:00.233814 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 319/620] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:22:00 2022] DELETE /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 28 10:22:00.242218 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-b17ee311-bf71-4a66-b4b5-f8680b2deaca tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:00.242815 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-b17ee311-bf71-4a66-b4b5-f8680b2deaca tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:00.249185 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b17ee311-bf71-4a66-b4b5-f8680b2deaca tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:00.249665 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b17ee311-bf71-4a66-b4b5-f8680b2deaca tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:00.250091 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b17ee311-bf71-4a66-b4b5-f8680b2deaca tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:00.250770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b17ee311-bf71-4a66-b4b5-f8680b2deaca tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:00.251208 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b17ee311-bf71-4a66-b4b5-f8680b2deaca tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:00.251624 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b17ee311-bf71-4a66-b4b5-f8680b2deaca tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:00.382701 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-b17ee311-bf71-4a66-b4b5-f8680b2deaca tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:00.391376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-b17ee311-bf71-4a66-b4b5-f8680b2deaca tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1680 microversion: 2.1 time: 0.153011 Aug 28 10:22:00.392114 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 302/621] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:00 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:22:00.893256 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-544cb3e3-3573-4bfa-a4aa-efca7e69f95f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:00.894012 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-544cb3e3-3573-4bfa-a4aa-efca7e69f95f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:00.900802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-544cb3e3-3573-4bfa-a4aa-efca7e69f95f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:00.901298 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-544cb3e3-3573-4bfa-a4aa-efca7e69f95f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:00.901696 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-544cb3e3-3573-4bfa-a4aa-efca7e69f95f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:00.902404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-544cb3e3-3573-4bfa-a4aa-efca7e69f95f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:00.902864 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-544cb3e3-3573-4bfa-a4aa-efca7e69f95f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:00.903285 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-544cb3e3-3573-4bfa-a4aa-efca7e69f95f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:01.033272 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-544cb3e3-3573-4bfa-a4aa-efca7e69f95f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:01.041922 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-544cb3e3-3573-4bfa-a4aa-efca7e69f95f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1735 microversion: 2.1 time: 0.152524 Aug 28 10:22:01.042482 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 320/622] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:00 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:01.413237 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-9dfcb1ad-3ddc-4b05-88ae-370d08e7ca60 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:01.413811 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-9dfcb1ad-3ddc-4b05-88ae-370d08e7ca60 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:01.421069 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9dfcb1ad-3ddc-4b05-88ae-370d08e7ca60 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:01.421549 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9dfcb1ad-3ddc-4b05-88ae-370d08e7ca60 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:01.421977 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9dfcb1ad-3ddc-4b05-88ae-370d08e7ca60 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:01.422668 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9dfcb1ad-3ddc-4b05-88ae-370d08e7ca60 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:01.423111 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9dfcb1ad-3ddc-4b05-88ae-370d08e7ca60 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:01.423523 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9dfcb1ad-3ddc-4b05-88ae-370d08e7ca60 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:01.555339 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-9dfcb1ad-3ddc-4b05-88ae-370d08e7ca60 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:01.566489 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-9dfcb1ad-3ddc-4b05-88ae-370d08e7ca60 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1680 microversion: 2.1 time: 0.157778 Aug 28 10:22:01.567054 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 303/623] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:01 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:02.068350 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4cf4fa9b-6e5b-4a6f-bc9c-8ea7fe0251bb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:02.069338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4cf4fa9b-6e5b-4a6f-bc9c-8ea7fe0251bb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:02.079938 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4cf4fa9b-6e5b-4a6f-bc9c-8ea7fe0251bb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:02.080784 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4cf4fa9b-6e5b-4a6f-bc9c-8ea7fe0251bb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:02.081506 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4cf4fa9b-6e5b-4a6f-bc9c-8ea7fe0251bb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:02.082626 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4cf4fa9b-6e5b-4a6f-bc9c-8ea7fe0251bb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:02.083374 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4cf4fa9b-6e5b-4a6f-bc9c-8ea7fe0251bb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:02.084068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4cf4fa9b-6e5b-4a6f-bc9c-8ea7fe0251bb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:02.090961 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:22:02.229226 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4cf4fa9b-6e5b-4a6f-bc9c-8ea7fe0251bb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:02.237638 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4cf4fa9b-6e5b-4a6f-bc9c-8ea7fe0251bb tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1735 microversion: 2.1 time: 0.176026 Aug 28 10:22:02.238210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 321/624] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:02 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:02.591799 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-734460c4-4b1e-4a9a-bc70-fdc681769b69 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:02.592806 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-734460c4-4b1e-4a9a-bc70-fdc681769b69 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:02.603737 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-734460c4-4b1e-4a9a-bc70-fdc681769b69 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:02.604558 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-734460c4-4b1e-4a9a-bc70-fdc681769b69 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:02.605292 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-734460c4-4b1e-4a9a-bc70-fdc681769b69 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:02.606410 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-734460c4-4b1e-4a9a-bc70-fdc681769b69 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:02.607152 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-734460c4-4b1e-4a9a-bc70-fdc681769b69 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:02.607847 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-734460c4-4b1e-4a9a-bc70-fdc681769b69 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:02.745999 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-734460c4-4b1e-4a9a-bc70-fdc681769b69 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:02.754251 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-734460c4-4b1e-4a9a-bc70-fdc681769b69 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1680 microversion: 2.1 time: 0.168885 Aug 28 10:22:02.754827 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 304/625] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:02 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:03.258985 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3e6a2458-cf6b-4489-a8ee-d184011d6887 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:03.259609 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3e6a2458-cf6b-4489-a8ee-d184011d6887 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:03.267198 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3e6a2458-cf6b-4489-a8ee-d184011d6887 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:03.267680 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3e6a2458-cf6b-4489-a8ee-d184011d6887 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:03.268110 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3e6a2458-cf6b-4489-a8ee-d184011d6887 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:03.268880 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3e6a2458-cf6b-4489-a8ee-d184011d6887 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:03.269330 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3e6a2458-cf6b-4489-a8ee-d184011d6887 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:03.269919 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3e6a2458-cf6b-4489-a8ee-d184011d6887 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:03.408302 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3e6a2458-cf6b-4489-a8ee-d184011d6887 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:03.417286 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3e6a2458-cf6b-4489-a8ee-d184011d6887 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1735 microversion: 2.1 time: 0.162265 Aug 28 10:22:03.417900 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 322/626] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:03 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:03.785862 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-170701c3-76b7-4092-844a-ebd9f164d04c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:03.786532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-170701c3-76b7-4092-844a-ebd9f164d04c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:03.794031 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-170701c3-76b7-4092-844a-ebd9f164d04c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:03.794565 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-170701c3-76b7-4092-844a-ebd9f164d04c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:03.795017 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-170701c3-76b7-4092-844a-ebd9f164d04c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:03.795749 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-170701c3-76b7-4092-844a-ebd9f164d04c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:03.796222 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-170701c3-76b7-4092-844a-ebd9f164d04c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:03.796669 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-170701c3-76b7-4092-844a-ebd9f164d04c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:03.943686 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-170701c3-76b7-4092-844a-ebd9f164d04c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:03.951578 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-170701c3-76b7-4092-844a-ebd9f164d04c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1680 microversion: 2.1 time: 0.172120 Aug 28 10:22:03.952163 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 305/627] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:03 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:04.438650 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-35a557ed-786a-4429-b74b-c54b86070ab2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:04.439993 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-35a557ed-786a-4429-b74b-c54b86070ab2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:04.446878 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35a557ed-786a-4429-b74b-c54b86070ab2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:04.447829 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35a557ed-786a-4429-b74b-c54b86070ab2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:04.458957 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35a557ed-786a-4429-b74b-c54b86070ab2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:04.459790 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35a557ed-786a-4429-b74b-c54b86070ab2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:04.460272 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35a557ed-786a-4429-b74b-c54b86070ab2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:04.460845 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35a557ed-786a-4429-b74b-c54b86070ab2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:04.597253 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-35a557ed-786a-4429-b74b-c54b86070ab2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:04.605931 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-35a557ed-786a-4429-b74b-c54b86070ab2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1735 microversion: 2.1 time: 0.171088 Aug 28 10:22:04.606516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 323/628] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:04 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:04.862237 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-06f80d7c-0473-421f-946b-62194a6183b6 req-b2de393e-d031-460b-83f9-9a009ed4eee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "109322c8-1668-4c81-bac7-b05bfacf1709", "name": "network-vif-deleted", "tag": "beb69a75-9bbc-4b73-b637-809ea041054b"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:22:04.872073 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-06f80d7c-0473-421f-946b-62194a6183b6 req-b2de393e-d031-460b-83f9-9a009ed4eee3 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:04.872617 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-06f80d7c-0473-421f-946b-62194a6183b6 req-b2de393e-d031-460b-83f9-9a009ed4eee3 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:04.873244 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-06f80d7c-0473-421f-946b-62194a6183b6 req-b2de393e-d031-460b-83f9-9a009ed4eee3 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:04.884577 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-06f80d7c-0473-421f-946b-62194a6183b6 req-b2de393e-d031-460b-83f9-9a009ed4eee3 service nova] Creating event network-vif-deleted:beb69a75-9bbc-4b73-b637-809ea041054b for instance 109322c8-1668-4c81-bac7-b05bfacf1709 on hv-cinder-85200 Aug 28 10:22:04.890291 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-06f80d7c-0473-421f-946b-62194a6183b6 req-b2de393e-d031-460b-83f9-9a009ed4eee3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094336 Aug 28 10:22:04.891137 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 306/629] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:22:04.972614 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2aca8abf-c19a-46d8-99fc-12630bcb652f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:04.973339 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2aca8abf-c19a-46d8-99fc-12630bcb652f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:04.979780 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2aca8abf-c19a-46d8-99fc-12630bcb652f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:04.980329 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2aca8abf-c19a-46d8-99fc-12630bcb652f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:04.980869 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2aca8abf-c19a-46d8-99fc-12630bcb652f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:04.981674 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2aca8abf-c19a-46d8-99fc-12630bcb652f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:04.982207 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2aca8abf-c19a-46d8-99fc-12630bcb652f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:04.982697 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2aca8abf-c19a-46d8-99fc-12630bcb652f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:05.048793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2aca8abf-c19a-46d8-99fc-12630bcb652f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:05.056914 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2aca8abf-c19a-46d8-99fc-12630bcb652f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1613 microversion: 2.1 time: 0.088355 Aug 28 10:22:05.057556 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 324/630] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:04 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1613 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:05.627609 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-44696832-a7db-4de7-bb22-9dc13b3f20f6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:05.628340 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-44696832-a7db-4de7-bb22-9dc13b3f20f6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:05.638342 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-44696832-a7db-4de7-bb22-9dc13b3f20f6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:05.641148 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-44696832-a7db-4de7-bb22-9dc13b3f20f6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:05.642650 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-44696832-a7db-4de7-bb22-9dc13b3f20f6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:05.643392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-44696832-a7db-4de7-bb22-9dc13b3f20f6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:05.643960 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-44696832-a7db-4de7-bb22-9dc13b3f20f6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:05.644656 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-44696832-a7db-4de7-bb22-9dc13b3f20f6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:05.822252 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-44696832-a7db-4de7-bb22-9dc13b3f20f6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:05.833402 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-44696832-a7db-4de7-bb22-9dc13b3f20f6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1715 microversion: 2.1 time: 0.210001 Aug 28 10:22:05.834009 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 307/631] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:05 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1715 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:22:05.981589 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b70c81e8-01b1-4273-b930-7229ce128a75 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:05.982140 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b70c81e8-01b1-4273-b930-7229ce128a75 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:05.988750 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b70c81e8-01b1-4273-b930-7229ce128a75 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:05.989217 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b70c81e8-01b1-4273-b930-7229ce128a75 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:05.989643 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b70c81e8-01b1-4273-b930-7229ce128a75 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:05.990323 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b70c81e8-01b1-4273-b930-7229ce128a75 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:05.990839 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b70c81e8-01b1-4273-b930-7229ce128a75 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:05.991249 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b70c81e8-01b1-4273-b930-7229ce128a75 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:06.078488 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-41ac3169-7ae1-495a-87ba-d40c8ca16c86 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:06.079666 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-41ac3169-7ae1-495a-87ba-d40c8ca16c86 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:06.087018 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-b70c81e8-01b1-4273-b930-7229ce128a75 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] HTTP exception thrown: Cannot 'detach_volume' instance c652c0fc-a515-4755-9eb4-8d46727fe990 while it is in vm_state rescued Aug 28 10:22:06.089200 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-41ac3169-7ae1-495a-87ba-d40c8ca16c86 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:06.089628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b70c81e8-01b1-4273-b930-7229ce128a75 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Request method failure captured: Aug 28 10:22:06.089628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: DELETE /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990/os-volume_attachments/55a867c7-4149-45b3-95d5-8c95e39153b8 HTTP/1.1 Aug 28 10:22:06.089628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:22:06.089628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:22:06.089628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:22:06.089628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:22:06.089628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:22:06.089628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:22:06.089628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:22:06.089628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:22:06.089628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0BdyAqhvO99cOM5hawKKYVu196vZNrBZRhFt1ByTfBso6IljPvRwmFtOxQ-5_REe3e3fIpeo_Uxe0JjEGytZ3lwxFlupsGmsBRkrCJVUAkjaIvPOzsCZzFrWjagztbQkpAi3Bsz_osgpmcHtCpoXF-xdis5QSWY4NN8aMRzRAADM90 Aug 28 10:22:06.089628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:22:06.089628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:22:06.089628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:22:06.089628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:22:06.089628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:22:06.089628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:22:06.089628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 76d489fb3d144cc3abf03a842e70636d Aug 28 10:22:06.089628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-925139782 Aug 28 10:22:06.089628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:22:06.089628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:22:06.091833 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_76d489fb3d144cc3abf03a842e70636d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/76d489fb3d144cc3abf03a842e70636d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/76d489fb3d144cc3abf03a842e70636d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/76d489fb3d144cc3abf03a842e70636d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:22:06.091833 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-ServerRescueNegativeTestJSON-925139782 Aug 28 10:22:06.091833 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 76d489fb3d144cc3abf03a842e70636d Aug 28 10:22:06.091833 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-925139782 Aug 28 10:22:06.091833 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-ServerRescueNegativeTestJSON-925139782-project Aug 28 10:22:06.091833 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:22:06.091833 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:22:06.091833 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: edbf26fde0254259a540f31139fc1a51 Aug 28 10:22:06.091833 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-ServerRescueNegativeTestJSON-925139782-project Aug 28 10:22:06.091833 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: > Aug 28 10:22:06.091833 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Cannot 'detach_volume' instance c652c0fc-a515-4755-9eb4-8d46727fe990 while it is in vm_state rescued Aug 28 10:22:06.092804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'server_id': 'c652c0fc-a515-4755-9eb4-8d46727fe990', 'id': '55a867c7-4149-45b3-95d5-8c95e39153b8'} Aug 28 10:22:06.092804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:22:06.092804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:22:06.092804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 28 10:22:06.092804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 28 10:22:06.092804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 28 10:22:06.092804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 28 10:22:06.092804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 28 10:22:06.092804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 28 10:22:06.092804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c652c0fc-a515-4755-9eb4-8d46727fe990 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 28 10:22:06.092804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:22:06.092804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:22:06.092804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:22:06.092804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:22:06.092804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:22:06.092804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:22:06.092804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:22:06.092804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:22:06.092804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:22:06.092804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:22:06.094579 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 28 10:22:06.094579 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 28 10:22:06.094579 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 28 10:22:06.094579 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 28 10:22:06.094579 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c652c0fc-a515-4755-9eb4-8d46727fe990 while it is in vm_state rescued Aug 28 10:22:06.094579 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:22:06.094579 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:22:06.094579 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:22:06.094579 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:22:06.094579 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:22:06.094579 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:22:06.094579 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:22:06.094579 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:22:06.094579 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c652c0fc-a515-4755-9eb4-8d46727fe990 while it is in vm_state rescued Aug 28 10:22:06.094579 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:22:06.096974 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-41ac3169-7ae1-495a-87ba-d40c8ca16c86 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:06.096974 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-41ac3169-7ae1-495a-87ba-d40c8ca16c86 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:06.096974 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-41ac3169-7ae1-495a-87ba-d40c8ca16c86 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:06.096974 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-41ac3169-7ae1-495a-87ba-d40c8ca16c86 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:06.097319 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-41ac3169-7ae1-495a-87ba-d40c8ca16c86 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:06.100263 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b70c81e8-01b1-4273-b930-7229ce128a75 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Returning 409 to user: Cannot 'detach_volume' instance c652c0fc-a515-4755-9eb4-8d46727fe990 while it is in vm_state rescued {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:22:06.101590 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b70c81e8-01b1-4273-b930-7229ce128a75 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990/os-volume_attachments/55a867c7-4149-45b3-95d5-8c95e39153b8" status: 409 len: 152 microversion: 2.1 time: 0.123970 Aug 28 10:22:06.102628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 325/632] 10.222.0.40 () {58 vars in 1416 bytes} [Sun Aug 28 10:22:05 2022] DELETE /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990/os-volume_attachments/55a867c7-4149-45b3-95d5-8c95e39153b8 => generated 152 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 28 10:22:06.114058 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1a083a4d-6441-45ae-85d6-489ac95cf221 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:22:06.114878 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1a083a4d-6441-45ae-85d6-489ac95cf221 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:06.124361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a083a4d-6441-45ae-85d6-489ac95cf221 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:06.126008 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a083a4d-6441-45ae-85d6-489ac95cf221 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:06.126759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a083a4d-6441-45ae-85d6-489ac95cf221 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:06.127884 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a083a4d-6441-45ae-85d6-489ac95cf221 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:06.129439 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a083a4d-6441-45ae-85d6-489ac95cf221 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:06.130077 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a083a4d-6441-45ae-85d6-489ac95cf221 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:06.153312 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-41ac3169-7ae1-495a-87ba-d40c8ca16c86 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:06.153845 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-41ac3169-7ae1-495a-87ba-d40c8ca16c86 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:06.154692 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-41ac3169-7ae1-495a-87ba-d40c8ca16c86 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:06.155497 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.objects.instance [None req-41ac3169-7ae1-495a-87ba-d40c8ca16c86 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lazy-loading 'fault' on Instance uuid 109322c8-1668-4c81-bac7-b05bfacf1709 {{(pid=120664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:22:06.236127 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-41ac3169-7ae1-495a-87ba-d40c8ca16c86 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:06.253106 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1a083a4d-6441-45ae-85d6-489ac95cf221 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "POST /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990/action" status: 202 len: 0 microversion: 2.1 time: 0.124855 Aug 28 10:22:06.254021 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 326/633] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Aug 28 10:22:06 2022] POST /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:22:06.263514 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-41ac3169-7ae1-495a-87ba-d40c8ca16c86 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 200 len: 1331 microversion: 2.1 time: 0.188318 Aug 28 10:22:06.273397 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-24c61787-3c1e-4a4e-9484-4674aea5e3d8 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:06.274702 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-24c61787-3c1e-4a4e-9484-4674aea5e3d8 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:06.279544 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 308/634] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:06 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 1331 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:22:06.282573 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24c61787-3c1e-4a4e-9484-4674aea5e3d8 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:06.283437 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24c61787-3c1e-4a4e-9484-4674aea5e3d8 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:06.283921 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24c61787-3c1e-4a4e-9484-4674aea5e3d8 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:06.284793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24c61787-3c1e-4a4e-9484-4674aea5e3d8 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:06.285241 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24c61787-3c1e-4a4e-9484-4674aea5e3d8 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:06.285654 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24c61787-3c1e-4a4e-9484-4674aea5e3d8 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:06.489520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-24c61787-3c1e-4a4e-9484-4674aea5e3d8 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:06.498222 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-24c61787-3c1e-4a4e-9484-4674aea5e3d8 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1723 microversion: 2.1 time: 0.236096 Aug 28 10:22:06.499088 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 327/635] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:06 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:07.286700 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4da29479-c2d2-4a53-ad59-3ab1958f0757 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:07.288004 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4da29479-c2d2-4a53-ad59-3ab1958f0757 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:07.294758 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4da29479-c2d2-4a53-ad59-3ab1958f0757 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:07.295457 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4da29479-c2d2-4a53-ad59-3ab1958f0757 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:07.296086 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4da29479-c2d2-4a53-ad59-3ab1958f0757 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:07.296803 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4da29479-c2d2-4a53-ad59-3ab1958f0757 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:07.297251 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4da29479-c2d2-4a53-ad59-3ab1958f0757 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:07.297783 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4da29479-c2d2-4a53-ad59-3ab1958f0757 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:07.313002 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-4da29479-c2d2-4a53-ad59-3ab1958f0757 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] HTTP exception thrown: Instance 109322c8-1668-4c81-bac7-b05bfacf1709 could not be found. Aug 28 10:22:07.314879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4da29479-c2d2-4a53-ad59-3ab1958f0757 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Request method failure captured: Aug 28 10:22:07.314879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 HTTP/1.1 Aug 28 10:22:07.314879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:22:07.314879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:22:07.314879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:22:07.314879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:22:07.314879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:22:07.314879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:22:07.314879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:22:07.314879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:22:07.314879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0BavBPfn9Wuv1kO4_4p6KYI6akLuIPAA1OxoMOfBpiurh2AuIBrDxo6hNz9wgslLyVrLvU5C-5Daa9wSWxwGejTKWsNtPvyULf4-HsU7LK2myKRcFzE4k1R7_TjPnuTN-hG4pARjml16ldcyWGxfFf1ULa1aMpcmJVMbJUsqOVrYCU Aug 28 10:22:07.314879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:22:07.314879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:22:07.314879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:22:07.314879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:22:07.314879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:22:07.314879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:22:07.314879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:22:07.314879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:22:07.314879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:22:07.314879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:22:07.316362 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_eefcb341ab8d4823a95c5bce47395083", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:22:07.316362 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:22:07.316362 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:22:07.316362 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:22:07.316362 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:22:07.316362 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:22:07.316362 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:22:07.316362 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: ed4711b7691643109007e173fee1c405 Aug 28 10:22:07.316362 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:22:07.316362 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: > Aug 28 10:22:07.316362 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Instance 109322c8-1668-4c81-bac7-b05bfacf1709 could not be found. Aug 28 10:22:07.316362 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': '109322c8-1668-4c81-bac7-b05bfacf1709'} Aug 28 10:22:07.317257 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:22:07.317257 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:22:07.317257 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:22:07.317257 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:22:07.317257 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:22:07.317257 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:22:07.317257 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:22:07.317257 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:22:07.317257 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:22:07.317257 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:22:07.317257 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 109322c8-1668-4c81-bac7-b05bfacf1709 could not be found. Aug 28 10:22:07.317257 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:22:07.317257 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:22:07.317257 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:22:07.317257 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:22:07.317257 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:22:07.317257 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:22:07.317257 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:22:07.317257 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:22:07.317257 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:22:07.318775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:22:07.318775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:22:07.318775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:22:07.318775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:22:07.318775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:22:07.318775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:22:07.318775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:22:07.318775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 109322c8-1668-4c81-bac7-b05bfacf1709 could not be found. Aug 28 10:22:07.318775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:22:07.318775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:22:07.318775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:22:07.318775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:22:07.318775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:22:07.318775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:22:07.318775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:22:07.318775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:22:07.318775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 109322c8-1668-4c81-bac7-b05bfacf1709 could not be found. Aug 28 10:22:07.318775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:22:07.322782 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4da29479-c2d2-4a53-ad59-3ab1958f0757 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Returning 404 to user: Instance 109322c8-1668-4c81-bac7-b05bfacf1709 could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:22:07.323897 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4da29479-c2d2-4a53-ad59-3ab1958f0757 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 404 len: 111 microversion: 2.1 time: 0.041143 Aug 28 10:22:07.328134 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 309/636] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:07 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:22:07.333009 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7c307c45-f20e-4a8a-b48a-ca9cfc2b3a97 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '.version_select at 0x7f7a1c28e0d0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:07.358550 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7c307c45-f20e-4a8a-b48a-ca9cfc2b3a97 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-173794329" status: 202 len: 0 microversion: 2.1 time: 0.029298 Aug 28 10:22:07.359373 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 328/637] 10.222.0.40 () {58 vars in 1218 bytes} [Sun Aug 28 10:22:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-173794329 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 28 10:22:07.522556 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-55c97020-ac0e-4e20-a189-373b342b626d tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:07.523123 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-55c97020-ac0e-4e20-a189-373b342b626d tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:07.529133 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-55c97020-ac0e-4e20-a189-373b342b626d tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:07.529965 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-55c97020-ac0e-4e20-a189-373b342b626d tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:07.530567 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-55c97020-ac0e-4e20-a189-373b342b626d tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:07.531423 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-55c97020-ac0e-4e20-a189-373b342b626d tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:07.532057 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-55c97020-ac0e-4e20-a189-373b342b626d tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:07.532693 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-55c97020-ac0e-4e20-a189-373b342b626d tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:07.762241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-55c97020-ac0e-4e20-a189-373b342b626d tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:07.771609 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-55c97020-ac0e-4e20-a189-373b342b626d tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1723 microversion: 2.1 time: 0.252976 Aug 28 10:22:07.784531 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 310/638] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:07 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:08.253428 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0eafe312-8d28-478e-bfcc-048f915b8991 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:08.253917 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0eafe312-8d28-478e-bfcc-048f915b8991 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:08.258779 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:22:08.264779 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0eafe312-8d28-478e-bfcc-048f915b8991 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:08.265460 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0eafe312-8d28-478e-bfcc-048f915b8991 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:08.266042 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0eafe312-8d28-478e-bfcc-048f915b8991 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:08.267015 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0eafe312-8d28-478e-bfcc-048f915b8991 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:08.267618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0eafe312-8d28-478e-bfcc-048f915b8991 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:08.268633 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0eafe312-8d28-478e-bfcc-048f915b8991 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:08.367883 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-0eafe312-8d28-478e-bfcc-048f915b8991 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lazy-loading 'services' on Instance uuid c41bc126-2936-43a3-a819-e9433bb7f8f4 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:22:08.452041 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0eafe312-8d28-478e-bfcc-048f915b8991 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4/os-volume_attachments/f6728751-c833-45bd-b37c-2cef24a537d2" status: 202 len: 0 microversion: 2.1 time: 0.202424 Aug 28 10:22:08.452939 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 329/639] 10.222.0.40 () {58 vars in 1416 bytes} [Sun Aug 28 10:22:08 2022] DELETE /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4/os-volume_attachments/f6728751-c833-45bd-b37c-2cef24a537d2 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:22:08.461384 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4e726254-b589-44bd-a39d-0e581f7ab3f1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:08.464308 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4e726254-b589-44bd-a39d-0e581f7ab3f1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:08.467230 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=43 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:22:08.473011 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4e726254-b589-44bd-a39d-0e581f7ab3f1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:08.473787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4e726254-b589-44bd-a39d-0e581f7ab3f1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:08.474377 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4e726254-b589-44bd-a39d-0e581f7ab3f1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:08.475260 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4e726254-b589-44bd-a39d-0e581f7ab3f1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:08.475866 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4e726254-b589-44bd-a39d-0e581f7ab3f1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:08.476437 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4e726254-b589-44bd-a39d-0e581f7ab3f1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:08.510503 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4e726254-b589-44bd-a39d-0e581f7ab3f1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053099 Aug 28 10:22:08.511438 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 311/640] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Aug 28 10:22:08 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:22:08.799133 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-baba31c6-9fab-4b64-b561-e00fdc43e1f2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:08.800340 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-baba31c6-9fab-4b64-b561-e00fdc43e1f2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:08.807093 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-baba31c6-9fab-4b64-b561-e00fdc43e1f2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:08.807697 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-baba31c6-9fab-4b64-b561-e00fdc43e1f2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:08.808214 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-baba31c6-9fab-4b64-b561-e00fdc43e1f2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:08.809450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-baba31c6-9fab-4b64-b561-e00fdc43e1f2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:08.810597 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-baba31c6-9fab-4b64-b561-e00fdc43e1f2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:08.811597 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-baba31c6-9fab-4b64-b561-e00fdc43e1f2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:08.967478 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-baba31c6-9fab-4b64-b561-e00fdc43e1f2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:08.976060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-baba31c6-9fab-4b64-b561-e00fdc43e1f2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1723 microversion: 2.1 time: 0.182296 Aug 28 10:22:08.989712 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 330/641] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:08 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:09.525286 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4a63bc27-316b-408a-b520-605a1ebdc739 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:09.528963 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4a63bc27-316b-408a-b520-605a1ebdc739 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:09.535608 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4a63bc27-316b-408a-b520-605a1ebdc739 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:09.536307 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4a63bc27-316b-408a-b520-605a1ebdc739 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:09.536866 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4a63bc27-316b-408a-b520-605a1ebdc739 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:09.537809 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4a63bc27-316b-408a-b520-605a1ebdc739 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:09.538510 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4a63bc27-316b-408a-b520-605a1ebdc739 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:09.539023 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4a63bc27-316b-408a-b520-605a1ebdc739 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:09.571826 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4a63bc27-316b-408a-b520-605a1ebdc739 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052715 Aug 28 10:22:09.573149 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 312/642] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Aug 28 10:22:09 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:22:09.997009 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-01c77e3f-8b7b-4843-b80e-6922da37b1ad tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:09.997734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-01c77e3f-8b7b-4843-b80e-6922da37b1ad tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:10.004232 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01c77e3f-8b7b-4843-b80e-6922da37b1ad tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:10.004936 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01c77e3f-8b7b-4843-b80e-6922da37b1ad tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:10.005561 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01c77e3f-8b7b-4843-b80e-6922da37b1ad tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:10.006257 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01c77e3f-8b7b-4843-b80e-6922da37b1ad tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:10.006860 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01c77e3f-8b7b-4843-b80e-6922da37b1ad tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:10.007275 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01c77e3f-8b7b-4843-b80e-6922da37b1ad tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:10.435589 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-01c77e3f-8b7b-4843-b80e-6922da37b1ad tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:10.445876 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-01c77e3f-8b7b-4843-b80e-6922da37b1ad tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1723 microversion: 2.1 time: 0.452579 Aug 28 10:22:10.447075 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 331/643] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:09 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1723 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:10.585215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-ec5e5826-cd7c-47ee-a95c-b5dfdbfcfffc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:10.588917 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-ec5e5826-cd7c-47ee-a95c-b5dfdbfcfffc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:10.595564 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ec5e5826-cd7c-47ee-a95c-b5dfdbfcfffc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:10.596345 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ec5e5826-cd7c-47ee-a95c-b5dfdbfcfffc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:10.597010 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ec5e5826-cd7c-47ee-a95c-b5dfdbfcfffc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:10.597955 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ec5e5826-cd7c-47ee-a95c-b5dfdbfcfffc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:10.598696 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ec5e5826-cd7c-47ee-a95c-b5dfdbfcfffc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:10.599269 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ec5e5826-cd7c-47ee-a95c-b5dfdbfcfffc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:10.633157 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-ec5e5826-cd7c-47ee-a95c-b5dfdbfcfffc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051981 Aug 28 10:22:10.634287 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 313/644] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Aug 28 10:22:10 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:22:11.467350 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-734833f4-bc4f-4ee2-a74d-47c5575ce6ad tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:11.469497 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-734833f4-bc4f-4ee2-a74d-47c5575ce6ad tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:11.480039 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-734833f4-bc4f-4ee2-a74d-47c5575ce6ad tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:11.480619 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-734833f4-bc4f-4ee2-a74d-47c5575ce6ad tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:11.480987 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-734833f4-bc4f-4ee2-a74d-47c5575ce6ad tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:11.481682 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-734833f4-bc4f-4ee2-a74d-47c5575ce6ad tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:11.482116 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-734833f4-bc4f-4ee2-a74d-47c5575ce6ad tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:11.482890 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-734833f4-bc4f-4ee2-a74d-47c5575ce6ad tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:11.646363 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-411e7cf4-42bf-40d5-a31f-bbcb6c256570 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:11.649302 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-411e7cf4-42bf-40d5-a31f-bbcb6c256570 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:11.656018 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-411e7cf4-42bf-40d5-a31f-bbcb6c256570 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:11.656788 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-411e7cf4-42bf-40d5-a31f-bbcb6c256570 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:11.657588 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-411e7cf4-42bf-40d5-a31f-bbcb6c256570 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:11.658555 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-411e7cf4-42bf-40d5-a31f-bbcb6c256570 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:11.659154 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-411e7cf4-42bf-40d5-a31f-bbcb6c256570 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:11.659724 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-411e7cf4-42bf-40d5-a31f-bbcb6c256570 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:11.727222 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-411e7cf4-42bf-40d5-a31f-bbcb6c256570 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084996 Aug 28 10:22:11.731564 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 314/645] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Aug 28 10:22:11 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 28 10:22:11.747877 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-734833f4-bc4f-4ee2-a74d-47c5575ce6ad tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:11.757864 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-734833f4-bc4f-4ee2-a74d-47c5575ce6ad tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1729 microversion: 2.1 time: 0.294306 Aug 28 10:22:11.758419 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 332/646] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:11 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1729 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:11.779323 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-49b4b6c8-1468-42d9-af10-b39c58f46e3f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:11.779830 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-49b4b6c8-1468-42d9-af10-b39c58f46e3f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:11.786107 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-49b4b6c8-1468-42d9-af10-b39c58f46e3f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:11.786596 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-49b4b6c8-1468-42d9-af10-b39c58f46e3f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:11.787021 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-49b4b6c8-1468-42d9-af10-b39c58f46e3f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:11.787718 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-49b4b6c8-1468-42d9-af10-b39c58f46e3f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:11.788152 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-49b4b6c8-1468-42d9-af10-b39c58f46e3f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:11.788593 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-49b4b6c8-1468-42d9-af10-b39c58f46e3f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:11.806680 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e268006b-f049-4dd4-b33c-826639abaa2f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:11.807456 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e268006b-f049-4dd4-b33c-826639abaa2f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:11.819060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e268006b-f049-4dd4-b33c-826639abaa2f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:11.819548 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e268006b-f049-4dd4-b33c-826639abaa2f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:11.820320 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e268006b-f049-4dd4-b33c-826639abaa2f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:11.821055 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e268006b-f049-4dd4-b33c-826639abaa2f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:11.821499 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e268006b-f049-4dd4-b33c-826639abaa2f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:11.825001 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e268006b-f049-4dd4-b33c-826639abaa2f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:11.859916 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e268006b-f049-4dd4-b33c-826639abaa2f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 28 10:22:11.894956 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-49b4b6c8-1468-42d9-af10-b39c58f46e3f tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119805 Aug 28 10:22:11.895567 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 315/647] 10.222.0.40 () {58 vars in 1275 bytes} [Sun Aug 28 10:22:11 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:22:11.963126 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e268006b-f049-4dd4-b33c-826639abaa2f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 204 len: 0 microversion: 2.1 time: 0.159955 Aug 28 10:22:11.968337 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 333/648] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:22:11 2022] DELETE /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 28 10:22:11.975056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c978f960-3b11-45d5-8732-78b18ab46c76 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:11.975721 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c978f960-3b11-45d5-8732-78b18ab46c76 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:11.984233 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c978f960-3b11-45d5-8732-78b18ab46c76 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:11.985301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c978f960-3b11-45d5-8732-78b18ab46c76 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:11.986069 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c978f960-3b11-45d5-8732-78b18ab46c76 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:11.987176 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c978f960-3b11-45d5-8732-78b18ab46c76 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:11.987905 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c978f960-3b11-45d5-8732-78b18ab46c76 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:11.988628 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c978f960-3b11-45d5-8732-78b18ab46c76 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:12.226181 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c978f960-3b11-45d5-8732-78b18ab46c76 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:12.236790 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c978f960-3b11-45d5-8732-78b18ab46c76 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1682 microversion: 2.1 time: 0.267399 Aug 28 10:22:12.237598 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 316/649] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:11 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1682 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:22:13.235221 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-0e1034c6-597d-407d-abc9-86c07aaf1a7c req-90d96d3c-ec3d-40aa-8d43-63d11f1c18c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c652c0fc-a515-4755-9eb4-8d46727fe990", "tag": "3db4dcbc-3ec6-4d01-8d04-71f8a8b8b4b0"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:22:13.246287 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-0e1034c6-597d-407d-abc9-86c07aaf1a7c req-90d96d3c-ec3d-40aa-8d43-63d11f1c18c6 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:13.246776 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-0e1034c6-597d-407d-abc9-86c07aaf1a7c req-90d96d3c-ec3d-40aa-8d43-63d11f1c18c6 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:13.247193 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-0e1034c6-597d-407d-abc9-86c07aaf1a7c req-90d96d3c-ec3d-40aa-8d43-63d11f1c18c6 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:13.258830 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-6af91914-3686-47db-9e15-9c6e67388f82 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:13.259474 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-6af91914-3686-47db-9e15-9c6e67388f82 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:13.262321 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-0e1034c6-597d-407d-abc9-86c07aaf1a7c req-90d96d3c-ec3d-40aa-8d43-63d11f1c18c6 service nova] Creating event network-changed:3db4dcbc-3ec6-4d01-8d04-71f8a8b8b4b0 for instance c652c0fc-a515-4755-9eb4-8d46727fe990 on hv-cinder-85200 Aug 28 10:22:13.269681 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6af91914-3686-47db-9e15-9c6e67388f82 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:13.271738 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-0e1034c6-597d-407d-abc9-86c07aaf1a7c req-90d96d3c-ec3d-40aa-8d43-63d11f1c18c6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.298557 Aug 28 10:22:13.272931 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 334/650] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:22:13.276722 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6af91914-3686-47db-9e15-9c6e67388f82 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:13.277408 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6af91914-3686-47db-9e15-9c6e67388f82 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:13.278395 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6af91914-3686-47db-9e15-9c6e67388f82 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:13.279053 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6af91914-3686-47db-9e15-9c6e67388f82 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:13.279695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6af91914-3686-47db-9e15-9c6e67388f82 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:13.526516 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-6af91914-3686-47db-9e15-9c6e67388f82 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:13.536628 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-6af91914-3686-47db-9e15-9c6e67388f82 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1682 microversion: 2.1 time: 0.281860 Aug 28 10:22:13.537797 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 317/651] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:13 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1682 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:14.573367 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-738891d5-37cf-4ce9-9733-1b13c4fcc406 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:14.574984 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-738891d5-37cf-4ce9-9733-1b13c4fcc406 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:14.582451 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-738891d5-37cf-4ce9-9733-1b13c4fcc406 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:14.582940 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-738891d5-37cf-4ce9-9733-1b13c4fcc406 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:14.583535 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-738891d5-37cf-4ce9-9733-1b13c4fcc406 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:14.585184 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-738891d5-37cf-4ce9-9733-1b13c4fcc406 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:14.585813 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-738891d5-37cf-4ce9-9733-1b13c4fcc406 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:14.586383 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-738891d5-37cf-4ce9-9733-1b13c4fcc406 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:14.744380 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-738891d5-37cf-4ce9-9733-1b13c4fcc406 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:14.752363 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-738891d5-37cf-4ce9-9733-1b13c4fcc406 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1682 microversion: 2.1 time: 0.197409 Aug 28 10:22:14.766024 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 335/652] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:14 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1682 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:15.292055 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-3195dd3f-8e43-4a05-9167-760d324b3d12 req-f56c06f3-485d-4d8d-bd4e-6b6e3d05a970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c652c0fc-a515-4755-9eb4-8d46727fe990", "tag": "3db4dcbc-3ec6-4d01-8d04-71f8a8b8b4b0"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:22:15.304224 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-3195dd3f-8e43-4a05-9167-760d324b3d12 req-f56c06f3-485d-4d8d-bd4e-6b6e3d05a970 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:15.304929 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-3195dd3f-8e43-4a05-9167-760d324b3d12 req-f56c06f3-485d-4d8d-bd4e-6b6e3d05a970 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:15.305609 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-3195dd3f-8e43-4a05-9167-760d324b3d12 req-f56c06f3-485d-4d8d-bd4e-6b6e3d05a970 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:15.309704 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=100 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:22:15.321682 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-3195dd3f-8e43-4a05-9167-760d324b3d12 req-f56c06f3-485d-4d8d-bd4e-6b6e3d05a970 service nova] Creating event network-changed:3db4dcbc-3ec6-4d01-8d04-71f8a8b8b4b0 for instance c652c0fc-a515-4755-9eb4-8d46727fe990 on hv-cinder-85200 Aug 28 10:22:15.327654 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-3195dd3f-8e43-4a05-9167-760d324b3d12 req-f56c06f3-485d-4d8d-bd4e-6b6e3d05a970 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042668 Aug 28 10:22:15.334520 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 318/653] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:22:15.773437 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-527821fc-3eab-446c-a504-e0868f724f2e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:15.774210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-527821fc-3eab-446c-a504-e0868f724f2e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:15.786748 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-527821fc-3eab-446c-a504-e0868f724f2e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:15.787558 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-527821fc-3eab-446c-a504-e0868f724f2e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:15.789334 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-527821fc-3eab-446c-a504-e0868f724f2e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:15.790278 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-527821fc-3eab-446c-a504-e0868f724f2e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:15.796333 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-527821fc-3eab-446c-a504-e0868f724f2e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:15.797204 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-527821fc-3eab-446c-a504-e0868f724f2e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:15.839071 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:22:15.934945 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-527821fc-3eab-446c-a504-e0868f724f2e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:15.945557 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-527821fc-3eab-446c-a504-e0868f724f2e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1615 microversion: 2.1 time: 0.175753 Aug 28 10:22:15.946897 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 336/654] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:15 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1615 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:16.250882 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-e63c1ebf-4a39-4e7f-ad83-fe17764f0579 req-c245e6e4-4c86-453b-88f6-07ce0069cb15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c41bc126-2936-43a3-a819-e9433bb7f8f4", "name": "network-vif-deleted", "tag": "f3149d41-a93c-4c32-b02d-c9686354c16c"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:22:16.267493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-e63c1ebf-4a39-4e7f-ad83-fe17764f0579 req-c245e6e4-4c86-453b-88f6-07ce0069cb15 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:16.281084 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-e63c1ebf-4a39-4e7f-ad83-fe17764f0579 req-c245e6e4-4c86-453b-88f6-07ce0069cb15 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:16.281705 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-e63c1ebf-4a39-4e7f-ad83-fe17764f0579 req-c245e6e4-4c86-453b-88f6-07ce0069cb15 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:16.304841 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-e63c1ebf-4a39-4e7f-ad83-fe17764f0579 req-c245e6e4-4c86-453b-88f6-07ce0069cb15 service nova] Creating event network-vif-deleted:f3149d41-a93c-4c32-b02d-c9686354c16c for instance c41bc126-2936-43a3-a819-e9433bb7f8f4 on hv-cinder-85200 Aug 28 10:22:16.317298 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-e63c1ebf-4a39-4e7f-ad83-fe17764f0579 req-c245e6e4-4c86-453b-88f6-07ce0069cb15 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072439 Aug 28 10:22:16.318544 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 319/655] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:22:16.968789 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7eb5ce75-324e-45a7-8536-88b1325faba7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:16.968789 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7eb5ce75-324e-45a7-8536-88b1325faba7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:16.979715 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7eb5ce75-324e-45a7-8536-88b1325faba7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:16.979715 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7eb5ce75-324e-45a7-8536-88b1325faba7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:16.979715 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7eb5ce75-324e-45a7-8536-88b1325faba7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:16.979715 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7eb5ce75-324e-45a7-8536-88b1325faba7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:16.980124 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7eb5ce75-324e-45a7-8536-88b1325faba7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:16.980443 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7eb5ce75-324e-45a7-8536-88b1325faba7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:17.025929 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7eb5ce75-324e-45a7-8536-88b1325faba7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:17.026823 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7eb5ce75-324e-45a7-8536-88b1325faba7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:17.027408 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7eb5ce75-324e-45a7-8536-88b1325faba7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:17.028093 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-7eb5ce75-324e-45a7-8536-88b1325faba7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lazy-loading 'fault' on Instance uuid c41bc126-2936-43a3-a819-e9433bb7f8f4 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:22:17.095060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7eb5ce75-324e-45a7-8536-88b1325faba7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:17.103299 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7eb5ce75-324e-45a7-8536-88b1325faba7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 200 len: 1332 microversion: 2.1 time: 0.140074 Aug 28 10:22:17.104263 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 337/656] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:16 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 1332 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:18.126787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-69d7890b-26e8-499b-98a6-ace9fff6f860 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:18.127474 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-69d7890b-26e8-499b-98a6-ace9fff6f860 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:18.140370 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-69d7890b-26e8-499b-98a6-ace9fff6f860 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:18.141081 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-69d7890b-26e8-499b-98a6-ace9fff6f860 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:18.141697 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-69d7890b-26e8-499b-98a6-ace9fff6f860 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:18.142613 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-69d7890b-26e8-499b-98a6-ace9fff6f860 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:18.143641 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-69d7890b-26e8-499b-98a6-ace9fff6f860 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:18.144248 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-69d7890b-26e8-499b-98a6-ace9fff6f860 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:18.165146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-69d7890b-26e8-499b-98a6-ace9fff6f860 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] HTTP exception thrown: Instance c41bc126-2936-43a3-a819-e9433bb7f8f4 could not be found. Aug 28 10:22:18.167507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-69d7890b-26e8-499b-98a6-ace9fff6f860 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Request method failure captured: Aug 28 10:22:18.167507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 HTTP/1.1 Aug 28 10:22:18.167507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:22:18.167507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:22:18.167507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:22:18.167507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:22:18.167507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:22:18.167507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:22:18.167507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:22:18.167507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:22:18.167507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0BavBPfn9Wuv1kO4_4p6KYI6akLuIPAA1OxoMOfBpiurh2AuIBrDxo6hNz9wgslLyVrLvU5C-5Daa9wSWxwGejTKWsNtPvyULf4-HsU7LK2myKRcFzE4k1R7_TjPnuTN-hG4pARjml16ldcyWGxfFf1ULa1aMpcmJVMbJUsqOVrYCU Aug 28 10:22:18.167507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:22:18.167507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:22:18.167507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:22:18.167507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:22:18.167507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:22:18.167507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:22:18.167507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:22:18.167507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:22:18.167507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:22:18.167507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:22:18.168843 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_eefcb341ab8d4823a95c5bce47395083", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:22:18.168843 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:22:18.168843 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:22:18.168843 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:22:18.168843 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:22:18.168843 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:22:18.168843 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:22:18.168843 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: ed4711b7691643109007e173fee1c405 Aug 28 10:22:18.168843 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:22:18.168843 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: > Aug 28 10:22:18.168843 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Instance c41bc126-2936-43a3-a819-e9433bb7f8f4 could not be found. Aug 28 10:22:18.168843 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': 'c41bc126-2936-43a3-a819-e9433bb7f8f4'} Aug 28 10:22:18.169589 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:22:18.169589 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:22:18.169589 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:22:18.169589 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:22:18.169589 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:22:18.169589 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:22:18.169589 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:22:18.169589 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:22:18.169589 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:22:18.169589 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:22:18.169589 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c41bc126-2936-43a3-a819-e9433bb7f8f4 could not be found. Aug 28 10:22:18.169589 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:22:18.169589 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:22:18.169589 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:22:18.169589 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:22:18.169589 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:22:18.169589 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:22:18.169589 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:22:18.169589 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:22:18.169589 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:22:18.170751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:22:18.170751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:22:18.170751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:22:18.170751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:22:18.170751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:22:18.170751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:22:18.170751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:22:18.170751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c41bc126-2936-43a3-a819-e9433bb7f8f4 could not be found. Aug 28 10:22:18.170751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:22:18.170751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:22:18.170751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:22:18.170751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:22:18.170751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:22:18.170751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:22:18.170751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:22:18.170751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:22:18.170751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c41bc126-2936-43a3-a819-e9433bb7f8f4 could not be found. Aug 28 10:22:18.170751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:22:18.173457 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-69d7890b-26e8-499b-98a6-ace9fff6f860 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Returning 404 to user: Instance c41bc126-2936-43a3-a819-e9433bb7f8f4 could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:22:18.174475 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-69d7890b-26e8-499b-98a6-ace9fff6f860 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 404 len: 111 microversion: 2.1 time: 0.052010 Aug 28 10:22:18.175441 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 320/657] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:18 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:22:18.183681 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-352bfd35-9463-482c-b2ff-d013e28d7267 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '.version_select at 0x7f7a1c2afb80>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:18.214222 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-352bfd35-9463-482c-b2ff-d013e28d7267 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1645604506" status: 202 len: 0 microversion: 2.1 time: 0.034260 Aug 28 10:22:18.215722 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 338/658] 10.222.0.40 () {58 vars in 1221 bytes} [Sun Aug 28 10:22:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1645604506 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:22:19.051016 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-bdb93f34-1ca0-404c-ac5d-006de1af69e4 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Action: 'create', calling method: .version_select at 0x7f7a1c13ef70>, body: {"keypair": {"name": "tempest-keypair-1654926663", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMv1o45VHiVf/Qb1syOHVAIKURP885r/LWNdsZnp9GTlYlmbYfQgiO+oFkWZ9Eg/+kKDY43vZEW01uQF88BYhQjKUqQvXD6W4FeOimU+5zVpPa1oiWUfB7Q01rVJo42fyA=="}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:22:19.067442 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-bdb93f34-1ca0-404c-ac5d-006de1af69e4 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Getting quotas for project eefcb341ab8d4823a95c5bce47395083. Resources: {'key_pairs'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:22:19.071830 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-bdb93f34-1ca0-404c-ac5d-006de1af69e4 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Getting quotas for user ed4711b7691643109007e173fee1c405 and project eefcb341ab8d4823a95c5bce47395083. Resources: {'key_pairs'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:22:19.084886 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bdb93f34-1ca0-404c-ac5d-006de1af69e4 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [2a3fc96b-fef1-4ba0-b507-cc51477c7b6e] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 28 10:22:19.238449 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f0a18115-141d-4e8d-9d1c-4e64144fe3af tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Action: 'create', calling method: .version_select at 0x7f7a1c179a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-413008888", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9GmmtpCRa45G7bpbBhs6hnibztZpYdZBWD0f8PdFOg3BEATBg28C861jJtDKO1bAOC38DI6dYXzPQMJ3wwgYLdBdBQFUcUvm3XtVVN0PLA6oPjkX79dC/vws3JZn6NKg=="}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:22:19.257159 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-f0a18115-141d-4e8d-9d1c-4e64144fe3af tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Getting quotas for project af70fccdef544a499725509ccd8c545f. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:22:19.261137 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-f0a18115-141d-4e8d-9d1c-4e64144fe3af tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Getting quotas for user 3deb7adb33004f1097574470754611ec and project af70fccdef544a499725509ccd8c545f. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:22:19.292265 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f0a18115-141d-4e8d-9d1c-4e64144fe3af tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.155066 Aug 28 10:22:19.292886 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 339/659] 10.222.0.40 () {60 vars in 1159 bytes} [Sun Aug 28 10:22:19 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:22:20.094068 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO oslo.messaging._drivers.impl_rabbit [None req-bdb93f34-1ca0-404c-ac5d-006de1af69e4 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [2a3fc96b-fef1-4ba0-b507-cc51477c7b6e] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 53120. Aug 28 10:22:20.111315 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-bdb93f34-1ca0-404c-ac5d-006de1af69e4 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.065937 Aug 28 10:22:20.111986 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 321/660] 10.222.0.40 () {60 vars in 1159 bytes} [Sun Aug 28 10:22:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:22:20.739557 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bbbf39d9-3ff8-42ae-948c-a68656d4f0ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:20.740861 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bbbf39d9-3ff8-42ae-948c-a68656d4f0ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:20.749011 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bbbf39d9-3ff8-42ae-948c-a68656d4f0ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:20.749874 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bbbf39d9-3ff8-42ae-948c-a68656d4f0ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:20.750475 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bbbf39d9-3ff8-42ae-948c-a68656d4f0ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:20.751436 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bbbf39d9-3ff8-42ae-948c-a68656d4f0ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:20.751885 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bbbf39d9-3ff8-42ae-948c-a68656d4f0ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:20.752279 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bbbf39d9-3ff8-42ae-948c-a68656d4f0ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:20.785969 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bbbf39d9-3ff8-42ae-948c-a68656d4f0ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193/os-volume_attachments/250ad4af-2e69-4f8c-a1ba-ba6144fab292" status: 200 len: 194 microversion: 2.20 time: 0.188261 Aug 28 10:22:20.787011 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 340/661] 10.222.0.40 () {60 vars in 1454 bytes} [Sun Aug 28 10:22:20 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193/os-volume_attachments/250ad4af-2e69-4f8c-a1ba-ba6144fab292 => generated 194 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 28 10:22:20.896076 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4ac556b6-434c-4b61-8fa3-bd1375f7e5e1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:20.897078 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4ac556b6-434c-4b61-8fa3-bd1375f7e5e1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:20.909488 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4ac556b6-434c-4b61-8fa3-bd1375f7e5e1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:20.910521 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4ac556b6-434c-4b61-8fa3-bd1375f7e5e1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:20.911194 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4ac556b6-434c-4b61-8fa3-bd1375f7e5e1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:20.912841 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4ac556b6-434c-4b61-8fa3-bd1375f7e5e1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:20.913503 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4ac556b6-434c-4b61-8fa3-bd1375f7e5e1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:20.914450 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4ac556b6-434c-4b61-8fa3-bd1375f7e5e1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:21.019494 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.objects.instance [None req-4ac556b6-434c-4b61-8fa3-bd1375f7e5e1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lazy-loading 'services' on Instance uuid 2a0819fc-2347-457b-804f-7ef819596193 {{(pid=120664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:22:21.116802 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4ac556b6-434c-4b61-8fa3-bd1375f7e5e1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193/os-volume_attachments/250ad4af-2e69-4f8c-a1ba-ba6144fab292" status: 202 len: 0 microversion: 2.20 time: 0.232945 Aug 28 10:22:21.121046 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 322/662] 10.222.0.40 () {60 vars in 1457 bytes} [Sun Aug 28 10:22:20 2022] DELETE /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193/os-volume_attachments/250ad4af-2e69-4f8c-a1ba-ba6144fab292 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 28 10:22:21.127778 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-311d2560-1b4b-45e7-8879-c7cce1892c1a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:21.131270 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-311d2560-1b4b-45e7-8879-c7cce1892c1a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:21.144132 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-311d2560-1b4b-45e7-8879-c7cce1892c1a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:21.144705 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-311d2560-1b4b-45e7-8879-c7cce1892c1a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:21.145207 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-311d2560-1b4b-45e7-8879-c7cce1892c1a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:21.146078 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-311d2560-1b4b-45e7-8879-c7cce1892c1a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:21.146518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-311d2560-1b4b-45e7-8879-c7cce1892c1a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:21.147092 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-311d2560-1b4b-45e7-8879-c7cce1892c1a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:21.185425 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-311d2560-1b4b-45e7-8879-c7cce1892c1a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062754 Aug 28 10:22:21.186354 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 341/663] 10.222.0.40 () {60 vars in 1343 bytes} [Sun Aug 28 10:22:21 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 28 10:22:21.626748 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c3710cf3-40b1-422a-9fc1-fbf59aaf0d20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2011669466", "imageRef": "2780c39b-8bd3-4e73-9669-2b2e29474f3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68250cdd-7701-4086-beb4-5863d8d92f6a"}], "security_groups": [{"name": "tempest-securitygroup--1152738272"}], "key_name": "tempest-keypair-1654926663", "user_data": "}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:22:21.740939 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.network.neutron [None req-c3710cf3-40b1-422a-9fc1-fbf59aaf0d20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] validate_networks() for [('68250cdd-7701-4086-beb4-5863d8d92f6a', None, None, None, None, None)] {{(pid=120664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 28 10:22:22.199614 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5e64e1e0-cfda-4b03-b10f-4b1e70681e4d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:22.202892 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5e64e1e0-cfda-4b03-b10f-4b1e70681e4d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:22.210452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5e64e1e0-cfda-4b03-b10f-4b1e70681e4d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:22.215350 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5e64e1e0-cfda-4b03-b10f-4b1e70681e4d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:22.215733 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5e64e1e0-cfda-4b03-b10f-4b1e70681e4d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:22.219137 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5e64e1e0-cfda-4b03-b10f-4b1e70681e4d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:22.219644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5e64e1e0-cfda-4b03-b10f-4b1e70681e4d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:22.220410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5e64e1e0-cfda-4b03-b10f-4b1e70681e4d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:22.259785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5e64e1e0-cfda-4b03-b10f-4b1e70681e4d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.065138 Aug 28 10:22:22.260600 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 342/664] 10.222.0.40 () {60 vars in 1343 bytes} [Sun Aug 28 10:22:22 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:22.294478 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-c3710cf3-40b1-422a-9fc1-fbf59aaf0d20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Flavor limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 28 10:22:22.294992 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-c3710cf3-40b1-422a-9fc1-fbf59aaf0d20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Image limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 28 10:22:22.295516 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-c3710cf3-40b1-422a-9fc1-fbf59aaf0d20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Flavor pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 28 10:22:22.295929 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-c3710cf3-40b1-422a-9fc1-fbf59aaf0d20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Image pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 28 10:22:22.296399 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-c3710cf3-40b1-422a-9fc1-fbf59aaf0d20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 28 10:22:22.306175 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c3710cf3-40b1-422a-9fc1-fbf59aaf0d20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:22.306750 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c3710cf3-40b1-422a-9fc1-fbf59aaf0d20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:22.307159 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c3710cf3-40b1-422a-9fc1-fbf59aaf0d20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:22.307882 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c3710cf3-40b1-422a-9fc1-fbf59aaf0d20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:22.308325 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c3710cf3-40b1-422a-9fc1-fbf59aaf0d20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:22.308773 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c3710cf3-40b1-422a-9fc1-fbf59aaf0d20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:22.333771 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-c3710cf3-40b1-422a-9fc1-fbf59aaf0d20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Getting quotas for project eefcb341ab8d4823a95c5bce47395083. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:22:22.336113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a93f8a11-6601-44bb-b2d6-da488cbb5607 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:22.336645 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a93f8a11-6601-44bb-b2d6-da488cbb5607 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:22.339221 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-c3710cf3-40b1-422a-9fc1-fbf59aaf0d20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Getting quotas for user ed4711b7691643109007e173fee1c405 and project eefcb341ab8d4823a95c5bce47395083. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:22:22.347774 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a93f8a11-6601-44bb-b2d6-da488cbb5607 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:22.348776 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a93f8a11-6601-44bb-b2d6-da488cbb5607 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:22.349805 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a93f8a11-6601-44bb-b2d6-da488cbb5607 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:22.351006 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a93f8a11-6601-44bb-b2d6-da488cbb5607 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:22.351924 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a93f8a11-6601-44bb-b2d6-da488cbb5607 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:22.352709 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a93f8a11-6601-44bb-b2d6-da488cbb5607 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:22.352936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c3710cf3-40b1-422a-9fc1-fbf59aaf0d20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Going to run 1 instances... {{(pid=120664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 28 10:22:22.355635 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c3710cf3-40b1-422a-9fc1-fbf59aaf0d20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2780c39b-8bd3-4e73-9669-2b2e29474f3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 28 10:22:22.389634 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a93f8a11-6601-44bb-b2d6-da488cbb5607 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 28 10:22:22.413533 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c3710cf3-40b1-422a-9fc1-fbf59aaf0d20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.791949 Aug 28 10:22:22.415432 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 323/665] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Aug 28 10:22:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 28 10:22:22.427888 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-7f730c5c-be06-45d5-bbc2-beb4ec37b254 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:22.428708 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-7f730c5c-be06-45d5-bbc2-beb4ec37b254 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:22.502891 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7f730c5c-be06-45d5-bbc2-beb4ec37b254 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:22.511815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a93f8a11-6601-44bb-b2d6-da488cbb5607 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 204 len: 0 microversion: 2.20 time: 0.179449 Aug 28 10:22:22.512886 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 343/666] 10.222.0.40 () {60 vars in 1280 bytes} [Sun Aug 28 10:22:22 2022] DELETE /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 28 10:22:22.516258 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-7f730c5c-be06-45d5-bbc2-beb4ec37b254 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 200 len: 1242 microversion: 2.1 time: 0.091682 Aug 28 10:22:22.516258 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 324/667] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:22 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:22.525598 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-2c8be497-66d6-4b9a-82b5-3b799924d1aa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:22.526252 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-2c8be497-66d6-4b9a-82b5-3b799924d1aa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:22.534175 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2c8be497-66d6-4b9a-82b5-3b799924d1aa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:22.534797 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2c8be497-66d6-4b9a-82b5-3b799924d1aa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:22.535381 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2c8be497-66d6-4b9a-82b5-3b799924d1aa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:22.536193 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2c8be497-66d6-4b9a-82b5-3b799924d1aa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:22.536738 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2c8be497-66d6-4b9a-82b5-3b799924d1aa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:22.537240 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2c8be497-66d6-4b9a-82b5-3b799924d1aa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:22.695448 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-2c8be497-66d6-4b9a-82b5-3b799924d1aa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:22.704583 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-2c8be497-66d6-4b9a-82b5-3b799924d1aa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:22.706403 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-2c8be497-66d6-4b9a-82b5-3b799924d1aa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:22.707789 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-2c8be497-66d6-4b9a-82b5-3b799924d1aa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.189620 Aug 28 10:22:22.708439 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 325/668] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:22:22 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:22:23.538831 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1e177537-a4c3-4490-bcc1-1779ef6df1a9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:23.539558 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1e177537-a4c3-4490-bcc1-1779ef6df1a9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:23.547164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e177537-a4c3-4490-bcc1-1779ef6df1a9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:23.547572 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e177537-a4c3-4490-bcc1-1779ef6df1a9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:23.547984 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e177537-a4c3-4490-bcc1-1779ef6df1a9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:23.548738 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e177537-a4c3-4490-bcc1-1779ef6df1a9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:23.549174 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e177537-a4c3-4490-bcc1-1779ef6df1a9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:23.549587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e177537-a4c3-4490-bcc1-1779ef6df1a9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:23.617093 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1e177537-a4c3-4490-bcc1-1779ef6df1a9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:23.625459 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1e177537-a4c3-4490-bcc1-1779ef6df1a9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 200 len: 1246 microversion: 2.1 time: 0.090881 Aug 28 10:22:23.626301 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 344/669] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:23 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:23.731532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-df7a9a74-70c0-4206-bb25-bc06504c7a8c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:23.732143 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-df7a9a74-70c0-4206-bb25-bc06504c7a8c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:23.739150 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-df7a9a74-70c0-4206-bb25-bc06504c7a8c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:23.739625 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-df7a9a74-70c0-4206-bb25-bc06504c7a8c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:23.740042 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-df7a9a74-70c0-4206-bb25-bc06504c7a8c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:23.740826 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-df7a9a74-70c0-4206-bb25-bc06504c7a8c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:23.741268 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-df7a9a74-70c0-4206-bb25-bc06504c7a8c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:23.741681 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-df7a9a74-70c0-4206-bb25-bc06504c7a8c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:23.878401 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-df7a9a74-70c0-4206-bb25-bc06504c7a8c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:23.887190 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-df7a9a74-70c0-4206-bb25-bc06504c7a8c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:23.888659 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-df7a9a74-70c0-4206-bb25-bc06504c7a8c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:23.889809 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-df7a9a74-70c0-4206-bb25-bc06504c7a8c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.162249 Aug 28 10:22:23.890403 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 326/670] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:22:23 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:22:24.646265 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7df3a009-64a4-400d-ad88-901493c59db9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:24.646872 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7df3a009-64a4-400d-ad88-901493c59db9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:24.654109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7df3a009-64a4-400d-ad88-901493c59db9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:24.654594 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7df3a009-64a4-400d-ad88-901493c59db9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:24.655027 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7df3a009-64a4-400d-ad88-901493c59db9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:24.655721 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7df3a009-64a4-400d-ad88-901493c59db9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:24.656264 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7df3a009-64a4-400d-ad88-901493c59db9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:24.656749 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7df3a009-64a4-400d-ad88-901493c59db9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:24.719533 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7df3a009-64a4-400d-ad88-901493c59db9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:24.728088 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7df3a009-64a4-400d-ad88-901493c59db9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 200 len: 1294 microversion: 2.1 time: 0.085811 Aug 28 10:22:24.728703 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 345/671] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:24 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:24.913139 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-b955af6b-38d5-41fb-9d21-ff1c3808e05a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:24.913786 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-b955af6b-38d5-41fb-9d21-ff1c3808e05a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:24.924892 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b955af6b-38d5-41fb-9d21-ff1c3808e05a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:24.925394 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b955af6b-38d5-41fb-9d21-ff1c3808e05a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:24.925997 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b955af6b-38d5-41fb-9d21-ff1c3808e05a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:24.926852 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b955af6b-38d5-41fb-9d21-ff1c3808e05a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:24.928038 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b955af6b-38d5-41fb-9d21-ff1c3808e05a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:24.928719 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b955af6b-38d5-41fb-9d21-ff1c3808e05a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:25.075745 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-b955af6b-38d5-41fb-9d21-ff1c3808e05a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:25.084103 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-b955af6b-38d5-41fb-9d21-ff1c3808e05a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:25.085788 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-b955af6b-38d5-41fb-9d21-ff1c3808e05a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:25.087019 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-b955af6b-38d5-41fb-9d21-ff1c3808e05a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1724 microversion: 2.20 time: 0.178019 Aug 28 10:22:25.087665 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 327/672] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:22:24 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:22:25.749359 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-250c7f4b-8f78-4aa2-b218-355f646e252d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:25.750606 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-250c7f4b-8f78-4aa2-b218-355f646e252d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:25.758498 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-250c7f4b-8f78-4aa2-b218-355f646e252d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:25.758990 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-250c7f4b-8f78-4aa2-b218-355f646e252d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:25.759474 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-250c7f4b-8f78-4aa2-b218-355f646e252d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:25.760736 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-250c7f4b-8f78-4aa2-b218-355f646e252d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:25.761230 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-250c7f4b-8f78-4aa2-b218-355f646e252d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:25.761657 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-250c7f4b-8f78-4aa2-b218-355f646e252d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:25.827902 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-250c7f4b-8f78-4aa2-b218-355f646e252d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:25.836693 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-250c7f4b-8f78-4aa2-b218-355f646e252d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 200 len: 1300 microversion: 2.1 time: 0.091331 Aug 28 10:22:25.837269 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 346/673] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:25 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:26.110485 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f3d8445b-2df2-454d-aa3e-35ccca42505a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:26.111172 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f3d8445b-2df2-454d-aa3e-35ccca42505a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:26.118031 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f3d8445b-2df2-454d-aa3e-35ccca42505a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:26.118494 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f3d8445b-2df2-454d-aa3e-35ccca42505a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:26.118924 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f3d8445b-2df2-454d-aa3e-35ccca42505a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:26.119621 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f3d8445b-2df2-454d-aa3e-35ccca42505a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:26.120065 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f3d8445b-2df2-454d-aa3e-35ccca42505a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:26.120482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f3d8445b-2df2-454d-aa3e-35ccca42505a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:26.187276 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f3d8445b-2df2-454d-aa3e-35ccca42505a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:26.195785 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f3d8445b-2df2-454d-aa3e-35ccca42505a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:26.197264 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f3d8445b-2df2-454d-aa3e-35ccca42505a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:26.198428 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f3d8445b-2df2-454d-aa3e-35ccca42505a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1656 microversion: 2.20 time: 0.092170 Aug 28 10:22:26.213232 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 328/674] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:22:26 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1656 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:22:26.376121 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-769bc092-0c91-4df2-abd4-927901fff827 req-af526d0c-cee1-4aa3-b724-53ae57f3223e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a0819fc-2347-457b-804f-7ef819596193", "name": "network-vif-deleted", "tag": "fe1c34ee-5586-4bd0-a9a5-7cc7349b7bd2"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:22:26.392103 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-769bc092-0c91-4df2-abd4-927901fff827 req-af526d0c-cee1-4aa3-b724-53ae57f3223e service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:26.393094 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-769bc092-0c91-4df2-abd4-927901fff827 req-af526d0c-cee1-4aa3-b724-53ae57f3223e service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:26.393889 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-769bc092-0c91-4df2-abd4-927901fff827 req-af526d0c-cee1-4aa3-b724-53ae57f3223e service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:26.437185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-769bc092-0c91-4df2-abd4-927901fff827 req-af526d0c-cee1-4aa3-b724-53ae57f3223e service nova] Creating event network-vif-deleted:fe1c34ee-5586-4bd0-a9a5-7cc7349b7bd2 for instance 2a0819fc-2347-457b-804f-7ef819596193 on hv-cinder-85200 Aug 28 10:22:26.444918 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-769bc092-0c91-4df2-abd4-927901fff827 req-af526d0c-cee1-4aa3-b724-53ae57f3223e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078679 Aug 28 10:22:26.446183 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 347/675] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:22:26.860669 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c5c69fc1-2259-4967-b413-8d20a550140e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:26.861589 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c5c69fc1-2259-4967-b413-8d20a550140e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:26.876789 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c5c69fc1-2259-4967-b413-8d20a550140e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:26.878283 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c5c69fc1-2259-4967-b413-8d20a550140e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:26.878870 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c5c69fc1-2259-4967-b413-8d20a550140e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:26.879750 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c5c69fc1-2259-4967-b413-8d20a550140e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:26.880357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c5c69fc1-2259-4967-b413-8d20a550140e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:26.881252 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c5c69fc1-2259-4967-b413-8d20a550140e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:27.062786 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c5c69fc1-2259-4967-b413-8d20a550140e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:27.071296 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c5c69fc1-2259-4967-b413-8d20a550140e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 200 len: 1368 microversion: 2.1 time: 0.216867 Aug 28 10:22:27.071992 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 329/676] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:26 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:27.223625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8537b46a-37cf-40fb-b909-82f0e69fb221 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:27.224627 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8537b46a-37cf-40fb-b909-82f0e69fb221 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:27.236631 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8537b46a-37cf-40fb-b909-82f0e69fb221 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:27.237109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8537b46a-37cf-40fb-b909-82f0e69fb221 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:27.241720 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8537b46a-37cf-40fb-b909-82f0e69fb221 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:27.242524 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8537b46a-37cf-40fb-b909-82f0e69fb221 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:27.242985 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8537b46a-37cf-40fb-b909-82f0e69fb221 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:27.249932 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8537b46a-37cf-40fb-b909-82f0e69fb221 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:27.298440 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8537b46a-37cf-40fb-b909-82f0e69fb221 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:27.299165 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8537b46a-37cf-40fb-b909-82f0e69fb221 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:27.299738 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8537b46a-37cf-40fb-b909-82f0e69fb221 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:27.300353 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-8537b46a-37cf-40fb-b909-82f0e69fb221 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lazy-loading 'fault' on Instance uuid 2a0819fc-2347-457b-804f-7ef819596193 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:22:27.369635 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8537b46a-37cf-40fb-b909-82f0e69fb221 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:27.378596 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8537b46a-37cf-40fb-b909-82f0e69fb221 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:27.381247 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8537b46a-37cf-40fb-b909-82f0e69fb221 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:27.382688 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8537b46a-37cf-40fb-b909-82f0e69fb221 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 200 len: 1371 microversion: 2.20 time: 0.164139 Aug 28 10:22:27.397041 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 348/677] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:22:27 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:22:28.094618 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-cee159cf-f7ea-48cc-8272-157031e0878a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:28.095378 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-cee159cf-f7ea-48cc-8272-157031e0878a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:28.104727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cee159cf-f7ea-48cc-8272-157031e0878a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:28.105413 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cee159cf-f7ea-48cc-8272-157031e0878a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:28.106061 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cee159cf-f7ea-48cc-8272-157031e0878a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:28.107041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cee159cf-f7ea-48cc-8272-157031e0878a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:28.107677 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cee159cf-f7ea-48cc-8272-157031e0878a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:28.108275 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cee159cf-f7ea-48cc-8272-157031e0878a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:28.251828 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-cee159cf-f7ea-48cc-8272-157031e0878a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:28.261676 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-cee159cf-f7ea-48cc-8272-157031e0878a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 200 len: 1368 microversion: 2.1 time: 0.172690 Aug 28 10:22:28.262267 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 330/678] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:28 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:28.407437 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-98a97dd6-b597-4e1c-95f7-2fb1c528405d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:28.408045 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-98a97dd6-b597-4e1c-95f7-2fb1c528405d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:28.414862 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98a97dd6-b597-4e1c-95f7-2fb1c528405d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:28.415337 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98a97dd6-b597-4e1c-95f7-2fb1c528405d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:28.415756 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98a97dd6-b597-4e1c-95f7-2fb1c528405d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:28.416460 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98a97dd6-b597-4e1c-95f7-2fb1c528405d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:28.417261 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98a97dd6-b597-4e1c-95f7-2fb1c528405d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:28.417738 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98a97dd6-b597-4e1c-95f7-2fb1c528405d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:28.432904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-98a97dd6-b597-4e1c-95f7-2fb1c528405d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] HTTP exception thrown: Instance 2a0819fc-2347-457b-804f-7ef819596193 could not be found. Aug 28 10:22:28.434585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-98a97dd6-b597-4e1c-95f7-2fb1c528405d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Request method failure captured: Aug 28 10:22:28.434585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 HTTP/1.1 Aug 28 10:22:28.434585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:22:28.434585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:22:28.434585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:22:28.434585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:22:28.434585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:22:28.434585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:22:28.434585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:22:28.434585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:22:28.434585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0BX4zckF5W_VQMpQL-Tvj04YthrXksO2vsYw445D5Fb__Du4hoI0szbqm0fbNp_6qriqMbu_Awspp-jUFbNi63humaBrZ-_evOjeeRbH0W0ELM178ttAw6g9QuDkWtqlxSQOMjTjxr8HB1gEyRg-dXxQG9u20cBxz-raM_9AO0-fQY Aug 28 10:22:28.434585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:22:28.434585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:22:28.434585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:22:28.434585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:22:28.434585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Openstack-Nova-Api-Version: 2.20 Aug 28 10:22:28.434585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:22:28.434585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:22:28.434585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 4a3dd0514b8542d280fbe2f798714ea3 Aug 28 10:22:28.434585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-246940552 Aug 28 10:22:28.434585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:22:28.434585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:22:28.436225 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4a3dd0514b8542d280fbe2f798714ea3", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a3dd0514b8542d280fbe2f798714ea3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a3dd0514b8542d280fbe2f798714ea3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4a3dd0514b8542d280fbe2f798714ea3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:22:28.436225 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeShelveTestJSON-246940552 Aug 28 10:22:28.436225 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 4a3dd0514b8542d280fbe2f798714ea3 Aug 28 10:22:28.436225 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-246940552 Aug 28 10:22:28.436225 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeShelveTestJSON-246940552-project Aug 28 10:22:28.436225 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:22:28.436225 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:22:28.436225 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: 5bb45c233ca243388bee05dede63415f Aug 28 10:22:28.436225 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeShelveTestJSON-246940552-project Aug 28 10:22:28.436225 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: > Aug 28 10:22:28.436225 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Instance 2a0819fc-2347-457b-804f-7ef819596193 could not be found. Aug 28 10:22:28.436225 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '2a0819fc-2347-457b-804f-7ef819596193'} Aug 28 10:22:28.437158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:22:28.437158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:22:28.437158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:22:28.437158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:22:28.437158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:22:28.437158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:22:28.437158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:22:28.437158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:22:28.437158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:22:28.437158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:22:28.437158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a0819fc-2347-457b-804f-7ef819596193 could not be found. Aug 28 10:22:28.437158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:22:28.437158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:22:28.437158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:22:28.437158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:22:28.437158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:22:28.437158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:22:28.437158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:22:28.437158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:22:28.437158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:22:28.438541 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:22:28.438541 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:22:28.438541 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:22:28.438541 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:22:28.438541 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:22:28.438541 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:22:28.438541 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:22:28.438541 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a0819fc-2347-457b-804f-7ef819596193 could not be found. Aug 28 10:22:28.438541 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:22:28.438541 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:22:28.438541 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:22:28.438541 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:22:28.438541 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:22:28.438541 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:22:28.438541 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:22:28.438541 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:22:28.438541 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a0819fc-2347-457b-804f-7ef819596193 could not be found. Aug 28 10:22:28.438541 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:22:28.439771 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-98a97dd6-b597-4e1c-95f7-2fb1c528405d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Returning 404 to user: Instance 2a0819fc-2347-457b-804f-7ef819596193 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:22:28.439771 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-98a97dd6-b597-4e1c-95f7-2fb1c528405d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 404 len: 111 microversion: 2.20 time: 0.033373 Aug 28 10:22:28.439771 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 349/679] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:22:28 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 28 10:22:28.445369 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-141d3427-75f6-46c4-a52e-c8da5ea56221 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '.version_select at 0x7f7a1c25e160>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:28.460330 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-0c55ea0f-b477-4168-ab5c-524ff30f5e49 req-651deec0-455e-43b2-a1a2-bc6fa8d7364d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b18b9c06-5718-489a-ab12-86a757322346", "tag": "776d23e6-7d32-4806-bb5f-8219e58b4651"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:22:28.469847 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-141d3427-75f6-46c4-a52e-c8da5ea56221 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-810335687" status: 204 len: 0 microversion: 2.20 time: 0.028383 Aug 28 10:22:28.470129 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-0c55ea0f-b477-4168-ab5c-524ff30f5e49 req-651deec0-455e-43b2-a1a2-bc6fa8d7364d service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:28.470631 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-0c55ea0f-b477-4168-ab5c-524ff30f5e49 req-651deec0-455e-43b2-a1a2-bc6fa8d7364d service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:28.470782 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 331/680] 10.222.0.40 () {60 vars in 1259 bytes} [Sun Aug 28 10:22:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-810335687 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 28 10:22:28.471074 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-0c55ea0f-b477-4168-ab5c-524ff30f5e49 req-651deec0-455e-43b2-a1a2-bc6fa8d7364d service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:28.483510 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-0c55ea0f-b477-4168-ab5c-524ff30f5e49 req-651deec0-455e-43b2-a1a2-bc6fa8d7364d service nova] Creating event network-changed:776d23e6-7d32-4806-bb5f-8219e58b4651 for instance b18b9c06-5718-489a-ab12-86a757322346 on hv-cinder-85200 Aug 28 10:22:28.489056 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-0c55ea0f-b477-4168-ab5c-524ff30f5e49 req-651deec0-455e-43b2-a1a2-bc6fa8d7364d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033245 Aug 28 10:22:28.489646 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 350/681] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:22:29.142160 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-d20b7d18-02ba-4d24-9b50-be876e85ea11 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Action: 'create', calling method: .version_select at 0x7f7a1c458ca0>, body: {"keypair": {"name": "tempest-keypair-56198054", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxSQT9gZ+dBcfX1yP1BXrbojj/ZzUkLUMpxXqd8yRtYF040MgNZALWLYiZYjBJbCSiLQNc7pP8cLjeA+qPchUZqr2OHY5FcFv2zvBMvhPiyFBu+1UQs+fap1YAD17kyCA=="}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:22:29.159401 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-d20b7d18-02ba-4d24-9b50-be876e85ea11 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Getting quotas for project 4a3dd0514b8542d280fbe2f798714ea3. Resources: {'key_pairs'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:22:29.163751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-d20b7d18-02ba-4d24-9b50-be876e85ea11 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Getting quotas for user 5bb45c233ca243388bee05dede63415f and project 4a3dd0514b8542d280fbe2f798714ea3. Resources: {'key_pairs'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:22:29.188751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-d20b7d18-02ba-4d24-9b50-be876e85ea11 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.050670 Aug 28 10:22:29.189558 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 332/682] 10.222.0.40 () {62 vars in 1200 bytes} [Sun Aug 28 10:22:29 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 28 10:22:29.279460 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=4 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:22:29.283790 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-db52d4ab-bfa5-4521-847e-1ca19d7cc845 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:29.284596 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-db52d4ab-bfa5-4521-847e-1ca19d7cc845 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:29.291200 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-db52d4ab-bfa5-4521-847e-1ca19d7cc845 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:29.292018 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-db52d4ab-bfa5-4521-847e-1ca19d7cc845 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:29.292437 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-db52d4ab-bfa5-4521-847e-1ca19d7cc845 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:29.293144 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-db52d4ab-bfa5-4521-847e-1ca19d7cc845 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:29.293586 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-db52d4ab-bfa5-4521-847e-1ca19d7cc845 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:29.294027 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-db52d4ab-bfa5-4521-847e-1ca19d7cc845 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:29.448221 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-db52d4ab-bfa5-4521-847e-1ca19d7cc845 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:29.457160 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-db52d4ab-bfa5-4521-847e-1ca19d7cc845 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 200 len: 1368 microversion: 2.1 time: 0.178689 Aug 28 10:22:29.457941 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 351/683] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:29 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:30.419253 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-ffa1854d-64be-4e5a-a2c3-f7679dcc2e37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-566745163", "imageRef": "2780c39b-8bd3-4e73-9669-2b2e29474f3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb2fa6e3-46ae-494d-a7b4-37d991375272"}], "security_groups": [{"name": "tempest-securitygroup--1125925789"}], "key_name": "tempest-keypair-56198054", "user_data": "}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:22:30.477906 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a9b79c04-6f8d-4ec0-8963-f547cedcd17e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:30.478502 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a9b79c04-6f8d-4ec0-8963-f547cedcd17e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:30.486600 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a9b79c04-6f8d-4ec0-8963-f547cedcd17e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:30.487148 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a9b79c04-6f8d-4ec0-8963-f547cedcd17e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:30.487704 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a9b79c04-6f8d-4ec0-8963-f547cedcd17e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:30.488557 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a9b79c04-6f8d-4ec0-8963-f547cedcd17e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:30.489077 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a9b79c04-6f8d-4ec0-8963-f547cedcd17e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:30.496053 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a9b79c04-6f8d-4ec0-8963-f547cedcd17e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:30.532201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.network.neutron [None req-ffa1854d-64be-4e5a-a2c3-f7679dcc2e37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] validate_networks() for [('bb2fa6e3-46ae-494d-a7b4-37d991375272', None, None, None, None, None)] {{(pid=120664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 28 10:22:30.721634 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a9b79c04-6f8d-4ec0-8963-f547cedcd17e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:30.729962 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a9b79c04-6f8d-4ec0-8963-f547cedcd17e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 200 len: 1368 microversion: 2.1 time: 0.255966 Aug 28 10:22:30.730599 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 352/684] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:30 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 1368 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:30.985387 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-ffa1854d-64be-4e5a-a2c3-f7679dcc2e37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Flavor limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 28 10:22:30.985807 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-ffa1854d-64be-4e5a-a2c3-f7679dcc2e37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Image limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 28 10:22:30.986278 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-ffa1854d-64be-4e5a-a2c3-f7679dcc2e37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Flavor pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 28 10:22:30.986707 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-ffa1854d-64be-4e5a-a2c3-f7679dcc2e37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Image pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 28 10:22:30.987059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-ffa1854d-64be-4e5a-a2c3-f7679dcc2e37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 28 10:22:30.996450 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ffa1854d-64be-4e5a-a2c3-f7679dcc2e37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:30.997001 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ffa1854d-64be-4e5a-a2c3-f7679dcc2e37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:30.997416 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ffa1854d-64be-4e5a-a2c3-f7679dcc2e37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:30.998123 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ffa1854d-64be-4e5a-a2c3-f7679dcc2e37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:30.998572 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ffa1854d-64be-4e5a-a2c3-f7679dcc2e37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:30.998990 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ffa1854d-64be-4e5a-a2c3-f7679dcc2e37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:31.016456 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-ffa1854d-64be-4e5a-a2c3-f7679dcc2e37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Getting quotas for project 4a3dd0514b8542d280fbe2f798714ea3. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:22:31.020694 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-ffa1854d-64be-4e5a-a2c3-f7679dcc2e37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Getting quotas for user 5bb45c233ca243388bee05dede63415f and project 4a3dd0514b8542d280fbe2f798714ea3. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:22:31.033625 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-ffa1854d-64be-4e5a-a2c3-f7679dcc2e37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Going to run 1 instances... {{(pid=120664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 28 10:22:31.035792 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-ffa1854d-64be-4e5a-a2c3-f7679dcc2e37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2780c39b-8bd3-4e73-9669-2b2e29474f3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 28 10:22:31.056587 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:22:31.085428 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-ffa1854d-64be-4e5a-a2c3-f7679dcc2e37 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.671489 Aug 28 10:22:31.092132 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 333/685] 10.222.0.40 () {62 vars in 1188 bytes} [Sun Aug 28 10:22:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 28 10:22:31.097607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-33fd71a3-104f-45d4-ac61-a27cbdcbc712 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:31.098233 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-33fd71a3-104f-45d4-ac61-a27cbdcbc712 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:31.159119 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-33fd71a3-104f-45d4-ac61-a27cbdcbc712 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:31.170815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-33fd71a3-104f-45d4-ac61-a27cbdcbc712 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:31.172683 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-33fd71a3-104f-45d4-ac61-a27cbdcbc712 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:31.173849 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-33fd71a3-104f-45d4-ac61-a27cbdcbc712 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1279 microversion: 2.20 time: 0.080292 Aug 28 10:22:31.174418 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 353/686] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:22:31 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1279 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:22:31.751009 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-d6cf1e79-42e6-4a17-aa16-d5edb72fed5d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:31.752423 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-d6cf1e79-42e6-4a17-aa16-d5edb72fed5d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:31.760083 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d6cf1e79-42e6-4a17-aa16-d5edb72fed5d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:31.760809 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d6cf1e79-42e6-4a17-aa16-d5edb72fed5d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:31.761229 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d6cf1e79-42e6-4a17-aa16-d5edb72fed5d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:31.762091 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d6cf1e79-42e6-4a17-aa16-d5edb72fed5d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:31.762554 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d6cf1e79-42e6-4a17-aa16-d5edb72fed5d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:31.762973 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d6cf1e79-42e6-4a17-aa16-d5edb72fed5d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:31.900861 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d6cf1e79-42e6-4a17-aa16-d5edb72fed5d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:31.908623 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-d6cf1e79-42e6-4a17-aa16-d5edb72fed5d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 200 len: 1368 microversion: 2.1 time: 0.162671 Aug 28 10:22:31.909173 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 334/687] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:31 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:32.196836 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a531eb84-9bd3-4802-bc25-e4ce1c38a4e5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:32.197448 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a531eb84-9bd3-4802-bc25-e4ce1c38a4e5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:32.204223 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a531eb84-9bd3-4802-bc25-e4ce1c38a4e5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:32.204776 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a531eb84-9bd3-4802-bc25-e4ce1c38a4e5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:32.205233 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a531eb84-9bd3-4802-bc25-e4ce1c38a4e5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:32.205962 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a531eb84-9bd3-4802-bc25-e4ce1c38a4e5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:32.206435 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a531eb84-9bd3-4802-bc25-e4ce1c38a4e5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:32.206878 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a531eb84-9bd3-4802-bc25-e4ce1c38a4e5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:32.273274 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a531eb84-9bd3-4802-bc25-e4ce1c38a4e5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:32.282143 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a531eb84-9bd3-4802-bc25-e4ce1c38a4e5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:32.283574 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a531eb84-9bd3-4802-bc25-e4ce1c38a4e5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:32.284800 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a531eb84-9bd3-4802-bc25-e4ce1c38a4e5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1331 microversion: 2.20 time: 0.092432 Aug 28 10:22:32.285366 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 354/688] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:22:32 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1331 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:22:32.943248 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-928ff616-2563-47af-9edd-5733d00c1390 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:32.943832 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-928ff616-2563-47af-9edd-5733d00c1390 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:32.950820 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-928ff616-2563-47af-9edd-5733d00c1390 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:32.951736 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-928ff616-2563-47af-9edd-5733d00c1390 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:32.951736 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-928ff616-2563-47af-9edd-5733d00c1390 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:32.952411 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-928ff616-2563-47af-9edd-5733d00c1390 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:32.952908 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-928ff616-2563-47af-9edd-5733d00c1390 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:32.953285 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-928ff616-2563-47af-9edd-5733d00c1390 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:33.086830 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-928ff616-2563-47af-9edd-5733d00c1390 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:33.094598 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-928ff616-2563-47af-9edd-5733d00c1390 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 200 len: 1368 microversion: 2.1 time: 0.155362 Aug 28 10:22:33.095154 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 335/689] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:32 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:33.314168 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c71ebd16-1518-4349-ac56-f0a4e65f55a9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:33.314755 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c71ebd16-1518-4349-ac56-f0a4e65f55a9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:33.335675 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c71ebd16-1518-4349-ac56-f0a4e65f55a9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:33.336228 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c71ebd16-1518-4349-ac56-f0a4e65f55a9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:33.336693 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c71ebd16-1518-4349-ac56-f0a4e65f55a9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:33.337393 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c71ebd16-1518-4349-ac56-f0a4e65f55a9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:33.337838 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c71ebd16-1518-4349-ac56-f0a4e65f55a9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:33.338647 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c71ebd16-1518-4349-ac56-f0a4e65f55a9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:33.363418 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:22:33.484301 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c71ebd16-1518-4349-ac56-f0a4e65f55a9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:33.493202 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c71ebd16-1518-4349-ac56-f0a4e65f55a9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:33.494865 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c71ebd16-1518-4349-ac56-f0a4e65f55a9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:33.495966 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c71ebd16-1518-4349-ac56-f0a4e65f55a9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1405 microversion: 2.20 time: 0.186622 Aug 28 10:22:33.496558 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 355/690] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:22:33 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:22:33.691071 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-b811afc4-3a85-4021-9eda-f5fe14ddd8a2 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:33.691981 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-b811afc4-3a85-4021-9eda-f5fe14ddd8a2 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:33.703340 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b811afc4-3a85-4021-9eda-f5fe14ddd8a2 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:33.704259 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b811afc4-3a85-4021-9eda-f5fe14ddd8a2 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:33.704879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b811afc4-3a85-4021-9eda-f5fe14ddd8a2 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:33.706348 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b811afc4-3a85-4021-9eda-f5fe14ddd8a2 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:33.706952 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b811afc4-3a85-4021-9eda-f5fe14ddd8a2 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:33.708320 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b811afc4-3a85-4021-9eda-f5fe14ddd8a2 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:33.799604 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-15abe0c4-9833-433c-9f87-c281fd1f42d6 req-1dfb93a0-3da8-447c-b5bb-4a2f5cbfc6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b18b9c06-5718-489a-ab12-86a757322346", "name": "network-vif-plugged", "status": "completed", "tag": "776d23e6-7d32-4806-bb5f-8219e58b4651"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:22:33.809959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-15abe0c4-9833-433c-9f87-c281fd1f42d6 req-1dfb93a0-3da8-447c-b5bb-4a2f5cbfc6b7 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:33.810636 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-15abe0c4-9833-433c-9f87-c281fd1f42d6 req-1dfb93a0-3da8-447c-b5bb-4a2f5cbfc6b7 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:33.811421 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-15abe0c4-9833-433c-9f87-c281fd1f42d6 req-1dfb93a0-3da8-447c-b5bb-4a2f5cbfc6b7 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:33.824766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-15abe0c4-9833-433c-9f87-c281fd1f42d6 req-1dfb93a0-3da8-447c-b5bb-4a2f5cbfc6b7 service nova] Creating event network-vif-plugged:776d23e6-7d32-4806-bb5f-8219e58b4651 for instance b18b9c06-5718-489a-ab12-86a757322346 on hv-cinder-85200 Aug 28 10:22:33.829791 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-15abe0c4-9833-433c-9f87-c281fd1f42d6 req-1dfb93a0-3da8-447c-b5bb-4a2f5cbfc6b7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106052 Aug 28 10:22:33.830570 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 356/691] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:22:33.833928 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.objects.instance [None req-b811afc4-3a85-4021-9eda-f5fe14ddd8a2 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lazy-loading 'services' on Instance uuid 71cd65ac-3099-4ac7-bf03-ed5173f6204f {{(pid=120664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:22:33.919907 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-b811afc4-3a85-4021-9eda-f5fe14ddd8a2 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "DELETE /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f/os-volume_attachments/e0cfb614-7d8c-44bf-9122-5db4ab27e702" status: 202 len: 0 microversion: 2.1 time: 0.232742 Aug 28 10:22:33.921032 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 336/692] 10.222.0.40 () {58 vars in 1416 bytes} [Sun Aug 28 10:22:33 2022] DELETE /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f/os-volume_attachments/e0cfb614-7d8c-44bf-9122-5db4ab27e702 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:22:34.116001 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c3fb18ae-2bbb-472f-965a-4988722c311c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:34.116878 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c3fb18ae-2bbb-472f-965a-4988722c311c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:34.123641 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3fb18ae-2bbb-472f-965a-4988722c311c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:34.124119 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3fb18ae-2bbb-472f-965a-4988722c311c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:34.124542 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3fb18ae-2bbb-472f-965a-4988722c311c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:34.125265 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3fb18ae-2bbb-472f-965a-4988722c311c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:34.125860 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3fb18ae-2bbb-472f-965a-4988722c311c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:34.126308 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3fb18ae-2bbb-472f-965a-4988722c311c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:34.180912 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-d493d7b2-e425-4bbc-b658-6fe96400b110 req-3a44f967-8ce4-419b-82b4-744114aebe6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6960433f-4e91-4c5b-9c8e-50645b6e13e7", "tag": "609522cc-a982-46e3-bc01-474519fee148"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:22:34.191606 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-d493d7b2-e425-4bbc-b658-6fe96400b110 req-3a44f967-8ce4-419b-82b4-744114aebe6c service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:34.192274 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-d493d7b2-e425-4bbc-b658-6fe96400b110 req-3a44f967-8ce4-419b-82b4-744114aebe6c service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:34.192905 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-d493d7b2-e425-4bbc-b658-6fe96400b110 req-3a44f967-8ce4-419b-82b4-744114aebe6c service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:34.205649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-d493d7b2-e425-4bbc-b658-6fe96400b110 req-3a44f967-8ce4-419b-82b4-744114aebe6c service nova] Creating event network-changed:609522cc-a982-46e3-bc01-474519fee148 for instance 6960433f-4e91-4c5b-9c8e-50645b6e13e7 on hv-cinder-85200 Aug 28 10:22:34.211345 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-d493d7b2-e425-4bbc-b658-6fe96400b110 req-3a44f967-8ce4-419b-82b4-744114aebe6c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035719 Aug 28 10:22:34.211945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 337/693] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:22:34.264247 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c3fb18ae-2bbb-472f-965a-4988722c311c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:34.272021 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c3fb18ae-2bbb-472f-965a-4988722c311c tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 200 len: 1368 microversion: 2.1 time: 0.160369 Aug 28 10:22:34.272607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 357/694] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:34 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:34.520927 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-134a846c-75ec-4892-8f3d-eee91a55172f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:34.522797 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-134a846c-75ec-4892-8f3d-eee91a55172f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:34.529378 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-134a846c-75ec-4892-8f3d-eee91a55172f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:34.529836 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-134a846c-75ec-4892-8f3d-eee91a55172f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:34.530291 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-134a846c-75ec-4892-8f3d-eee91a55172f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:34.530990 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-134a846c-75ec-4892-8f3d-eee91a55172f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:34.531439 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-134a846c-75ec-4892-8f3d-eee91a55172f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:34.531860 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-134a846c-75ec-4892-8f3d-eee91a55172f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:34.664104 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-134a846c-75ec-4892-8f3d-eee91a55172f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:34.672867 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-134a846c-75ec-4892-8f3d-eee91a55172f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:34.674597 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-134a846c-75ec-4892-8f3d-eee91a55172f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:34.675723 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-134a846c-75ec-4892-8f3d-eee91a55172f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1405 microversion: 2.20 time: 0.159848 Aug 28 10:22:34.676310 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 338/695] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:22:34 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:22:35.296627 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ae315af2-6a5d-46b3-92b2-5f351677142d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:35.297238 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ae315af2-6a5d-46b3-92b2-5f351677142d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:35.303906 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae315af2-6a5d-46b3-92b2-5f351677142d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:35.304383 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae315af2-6a5d-46b3-92b2-5f351677142d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:35.304898 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae315af2-6a5d-46b3-92b2-5f351677142d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:35.305586 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae315af2-6a5d-46b3-92b2-5f351677142d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:35.306091 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae315af2-6a5d-46b3-92b2-5f351677142d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:35.306585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae315af2-6a5d-46b3-92b2-5f351677142d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:35.438702 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ae315af2-6a5d-46b3-92b2-5f351677142d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:35.446327 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ae315af2-6a5d-46b3-92b2-5f351677142d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 200 len: 1368 microversion: 2.1 time: 0.153775 Aug 28 10:22:35.446900 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 358/696] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:35 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:35.701272 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-46706c1a-ca03-439e-bf7a-e680b9cbc5fe tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:35.701992 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-46706c1a-ca03-439e-bf7a-e680b9cbc5fe tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:35.710309 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46706c1a-ca03-439e-bf7a-e680b9cbc5fe tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:35.710890 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46706c1a-ca03-439e-bf7a-e680b9cbc5fe tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:35.711447 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46706c1a-ca03-439e-bf7a-e680b9cbc5fe tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:35.712293 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46706c1a-ca03-439e-bf7a-e680b9cbc5fe tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:35.712886 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46706c1a-ca03-439e-bf7a-e680b9cbc5fe tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:35.713405 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46706c1a-ca03-439e-bf7a-e680b9cbc5fe tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:35.847496 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-46706c1a-ca03-439e-bf7a-e680b9cbc5fe tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:35.856342 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-46706c1a-ca03-439e-bf7a-e680b9cbc5fe tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:35.858294 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-46706c1a-ca03-439e-bf7a-e680b9cbc5fe tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:35.859414 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-46706c1a-ca03-439e-bf7a-e680b9cbc5fe tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1405 microversion: 2.20 time: 0.163567 Aug 28 10:22:35.859979 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 339/697] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:22:35 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:22:36.471116 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6861dff0-8edd-4061-b65c-d4c03064c74a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:36.471983 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6861dff0-8edd-4061-b65c-d4c03064c74a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:36.481167 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6861dff0-8edd-4061-b65c-d4c03064c74a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:36.481647 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6861dff0-8edd-4061-b65c-d4c03064c74a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:36.482078 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6861dff0-8edd-4061-b65c-d4c03064c74a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:36.482771 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6861dff0-8edd-4061-b65c-d4c03064c74a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:36.483222 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6861dff0-8edd-4061-b65c-d4c03064c74a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:36.483640 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6861dff0-8edd-4061-b65c-d4c03064c74a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:36.615056 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6861dff0-8edd-4061-b65c-d4c03064c74a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:36.622986 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6861dff0-8edd-4061-b65c-d4c03064c74a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 200 len: 1368 microversion: 2.1 time: 0.158597 Aug 28 10:22:36.623566 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 359/698] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:36 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:36.886339 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-32511ee3-32b8-4342-94c7-07474526c802 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:36.887620 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-32511ee3-32b8-4342-94c7-07474526c802 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:36.894442 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-32511ee3-32b8-4342-94c7-07474526c802 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:36.894978 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-32511ee3-32b8-4342-94c7-07474526c802 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:36.895433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-32511ee3-32b8-4342-94c7-07474526c802 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:36.896153 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-32511ee3-32b8-4342-94c7-07474526c802 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:36.896642 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-32511ee3-32b8-4342-94c7-07474526c802 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:36.897259 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-32511ee3-32b8-4342-94c7-07474526c802 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:37.030943 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-32511ee3-32b8-4342-94c7-07474526c802 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:37.039440 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-32511ee3-32b8-4342-94c7-07474526c802 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:37.041008 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-32511ee3-32b8-4342-94c7-07474526c802 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:37.042516 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-32511ee3-32b8-4342-94c7-07474526c802 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1405 microversion: 2.20 time: 0.160610 Aug 28 10:22:37.043174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 340/699] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:22:36 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:22:37.203532 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2b5beb2d-b502-4083-ad47-1ad46405a0da tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:22:37.209922 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b5beb2d-b502-4083-ad47-1ad46405a0da tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:37.210371 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b5beb2d-b502-4083-ad47-1ad46405a0da tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:37.210829 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b5beb2d-b502-4083-ad47-1ad46405a0da tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:37.233308 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2b5beb2d-b502-4083-ad47-1ad46405a0da tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Going to try to stop instance {{(pid=120663) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 28 10:22:37.279465 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2b5beb2d-b502-4083-ad47-1ad46405a0da tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "POST /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f/action" status: 202 len: 0 microversion: 2.1 time: 0.079754 Aug 28 10:22:37.280055 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 360/700] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Aug 28 10:22:37 2022] POST /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:22:37.288394 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-7cf1a0bc-c6c8-4117-bad6-2d65b6e1b9d9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:37.289021 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-7cf1a0bc-c6c8-4117-bad6-2d65b6e1b9d9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:37.295458 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7cf1a0bc-c6c8-4117-bad6-2d65b6e1b9d9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:37.295927 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7cf1a0bc-c6c8-4117-bad6-2d65b6e1b9d9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:37.296349 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7cf1a0bc-c6c8-4117-bad6-2d65b6e1b9d9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:37.297064 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7cf1a0bc-c6c8-4117-bad6-2d65b6e1b9d9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:37.297505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7cf1a0bc-c6c8-4117-bad6-2d65b6e1b9d9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:37.297916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7cf1a0bc-c6c8-4117-bad6-2d65b6e1b9d9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:37.312652 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:22:37.428288 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7cf1a0bc-c6c8-4117-bad6-2d65b6e1b9d9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:37.436342 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-7cf1a0bc-c6c8-4117-bad6-2d65b6e1b9d9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1677 microversion: 2.1 time: 0.151733 Aug 28 10:22:37.436922 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 341/701] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:37 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:37.647999 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a02a75f9-6506-4e96-8976-6be1fb96ace9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:37.649009 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a02a75f9-6506-4e96-8976-6be1fb96ace9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:37.656109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a02a75f9-6506-4e96-8976-6be1fb96ace9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:37.656537 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a02a75f9-6506-4e96-8976-6be1fb96ace9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:37.656973 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a02a75f9-6506-4e96-8976-6be1fb96ace9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:37.657694 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a02a75f9-6506-4e96-8976-6be1fb96ace9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:37.658136 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a02a75f9-6506-4e96-8976-6be1fb96ace9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:37.658551 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a02a75f9-6506-4e96-8976-6be1fb96ace9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:37.797535 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a02a75f9-6506-4e96-8976-6be1fb96ace9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:37.805633 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a02a75f9-6506-4e96-8976-6be1fb96ace9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 200 len: 1558 microversion: 2.1 time: 0.164619 Aug 28 10:22:37.806271 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 361/702] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:37 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:37.833331 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-5b749368-e648-4d0c-ba79-305a0410c261 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:37.833820 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-5b749368-e648-4d0c-ba79-305a0410c261 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:37.840331 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5b749368-e648-4d0c-ba79-305a0410c261 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:37.840847 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5b749368-e648-4d0c-ba79-305a0410c261 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:37.841278 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5b749368-e648-4d0c-ba79-305a0410c261 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:37.841968 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5b749368-e648-4d0c-ba79-305a0410c261 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:37.842430 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5b749368-e648-4d0c-ba79-305a0410c261 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:37.842831 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5b749368-e648-4d0c-ba79-305a0410c261 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:37.919763 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-5b749368-e648-4d0c-ba79-305a0410c261 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090377 Aug 28 10:22:37.920373 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 342/703] 10.222.0.40 () {58 vars in 1275 bytes} [Sun Aug 28 10:22:37 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:22:38.065161 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9ec50e4d-8196-4672-bfda-2198f4412c26 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:38.065888 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9ec50e4d-8196-4672-bfda-2198f4412c26 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:38.072297 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ec50e4d-8196-4672-bfda-2198f4412c26 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:38.072869 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ec50e4d-8196-4672-bfda-2198f4412c26 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:38.073408 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ec50e4d-8196-4672-bfda-2198f4412c26 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:38.074150 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ec50e4d-8196-4672-bfda-2198f4412c26 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:38.074689 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ec50e4d-8196-4672-bfda-2198f4412c26 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:38.075109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ec50e4d-8196-4672-bfda-2198f4412c26 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:38.457728 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-5500f884-82be-4684-a734-60f2dde91948 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:38.458298 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-5500f884-82be-4684-a734-60f2dde91948 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:38.464924 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5500f884-82be-4684-a734-60f2dde91948 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:38.465409 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5500f884-82be-4684-a734-60f2dde91948 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:38.465840 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5500f884-82be-4684-a734-60f2dde91948 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:38.466622 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5500f884-82be-4684-a734-60f2dde91948 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:38.467108 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5500f884-82be-4684-a734-60f2dde91948 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:38.467525 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5500f884-82be-4684-a734-60f2dde91948 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:38.586003 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9ec50e4d-8196-4672-bfda-2198f4412c26 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:38.596133 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9ec50e4d-8196-4672-bfda-2198f4412c26 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:38.597616 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9ec50e4d-8196-4672-bfda-2198f4412c26 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:38.598718 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9ec50e4d-8196-4672-bfda-2198f4412c26 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1405 microversion: 2.20 time: 0.537549 Aug 28 10:22:38.599552 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 362/704] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:22:38 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1405 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:22:38.708146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-5500f884-82be-4684-a734-60f2dde91948 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:38.716468 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-5500f884-82be-4684-a734-60f2dde91948 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1677 microversion: 2.1 time: 0.262657 Aug 28 10:22:38.717072 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 343/705] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:38 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1677 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:39.216904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-468c3123-280c-482f-8a56-9cd707bf813e req-89615345-15fb-4461-8398-63ab2b2d4dab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b18b9c06-5718-489a-ab12-86a757322346", "tag": "776d23e6-7d32-4806-bb5f-8219e58b4651"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:22:39.223376 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:22:39.227315 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-468c3123-280c-482f-8a56-9cd707bf813e req-89615345-15fb-4461-8398-63ab2b2d4dab service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:39.227782 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-468c3123-280c-482f-8a56-9cd707bf813e req-89615345-15fb-4461-8398-63ab2b2d4dab service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:39.228197 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-468c3123-280c-482f-8a56-9cd707bf813e req-89615345-15fb-4461-8398-63ab2b2d4dab service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:39.241093 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-468c3123-280c-482f-8a56-9cd707bf813e req-89615345-15fb-4461-8398-63ab2b2d4dab service nova] Creating event network-changed:776d23e6-7d32-4806-bb5f-8219e58b4651 for instance b18b9c06-5718-489a-ab12-86a757322346 on hv-cinder-85200 Aug 28 10:22:39.246312 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-468c3123-280c-482f-8a56-9cd707bf813e req-89615345-15fb-4461-8398-63ab2b2d4dab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033186 Aug 28 10:22:39.246888 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 363/706] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:22:39.621396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-9d1a4b07-e672-4c39-86f5-d43b14bdee8b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:39.621965 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-9d1a4b07-e672-4c39-86f5-d43b14bdee8b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:39.628723 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9d1a4b07-e672-4c39-86f5-d43b14bdee8b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:39.629196 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9d1a4b07-e672-4c39-86f5-d43b14bdee8b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:39.629619 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9d1a4b07-e672-4c39-86f5-d43b14bdee8b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:39.630300 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9d1a4b07-e672-4c39-86f5-d43b14bdee8b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:39.630738 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9d1a4b07-e672-4c39-86f5-d43b14bdee8b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:39.631149 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9d1a4b07-e672-4c39-86f5-d43b14bdee8b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:39.768944 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-9d1a4b07-e672-4c39-86f5-d43b14bdee8b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:39.777392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-9d1a4b07-e672-4c39-86f5-d43b14bdee8b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:39.779150 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-9d1a4b07-e672-4c39-86f5-d43b14bdee8b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:39.780278 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-9d1a4b07-e672-4c39-86f5-d43b14bdee8b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1405 microversion: 2.20 time: 0.162947 Aug 28 10:22:39.780878 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 344/707] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:22:39 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:22:39.862300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e856372e-e0e1-46b6-988a-ab5cddc8fbe2 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:39.862999 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e856372e-e0e1-46b6-988a-ab5cddc8fbe2 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:39.869591 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e856372e-e0e1-46b6-988a-ab5cddc8fbe2 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:39.870094 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e856372e-e0e1-46b6-988a-ab5cddc8fbe2 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:39.870523 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e856372e-e0e1-46b6-988a-ab5cddc8fbe2 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:39.871215 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e856372e-e0e1-46b6-988a-ab5cddc8fbe2 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:39.871661 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e856372e-e0e1-46b6-988a-ab5cddc8fbe2 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:39.872076 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e856372e-e0e1-46b6-988a-ab5cddc8fbe2 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:40.003491 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e856372e-e0e1-46b6-988a-ab5cddc8fbe2 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:40.011852 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e856372e-e0e1-46b6-988a-ab5cddc8fbe2 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1677 microversion: 2.1 time: 0.277633 Aug 28 10:22:40.012354 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 364/708] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:39 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1677 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:40.808440 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-cdf44d82-3e33-4d92-ab19-1aa90618d9ef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:40.809494 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-cdf44d82-3e33-4d92-ab19-1aa90618d9ef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:40.820566 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cdf44d82-3e33-4d92-ab19-1aa90618d9ef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:40.821383 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cdf44d82-3e33-4d92-ab19-1aa90618d9ef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:40.822090 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cdf44d82-3e33-4d92-ab19-1aa90618d9ef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:40.823219 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cdf44d82-3e33-4d92-ab19-1aa90618d9ef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:40.823950 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cdf44d82-3e33-4d92-ab19-1aa90618d9ef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:40.824695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cdf44d82-3e33-4d92-ab19-1aa90618d9ef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:40.963435 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-cdf44d82-3e33-4d92-ab19-1aa90618d9ef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:40.972198 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-cdf44d82-3e33-4d92-ab19-1aa90618d9ef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:40.973668 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-cdf44d82-3e33-4d92-ab19-1aa90618d9ef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:40.974767 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-cdf44d82-3e33-4d92-ab19-1aa90618d9ef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1405 microversion: 2.20 time: 0.173046 Aug 28 10:22:40.975328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 345/709] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:22:40 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:22:41.033172 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-48b7f52f-d069-452e-8191-84b46628944d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:41.033751 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-48b7f52f-d069-452e-8191-84b46628944d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:41.040865 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48b7f52f-d069-452e-8191-84b46628944d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:41.041365 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48b7f52f-d069-452e-8191-84b46628944d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:41.042133 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48b7f52f-d069-452e-8191-84b46628944d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:41.042824 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48b7f52f-d069-452e-8191-84b46628944d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:41.043274 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48b7f52f-d069-452e-8191-84b46628944d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:41.043693 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48b7f52f-d069-452e-8191-84b46628944d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:41.164133 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:22:41.177996 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-48b7f52f-d069-452e-8191-84b46628944d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:41.186047 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-48b7f52f-d069-452e-8191-84b46628944d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1677 microversion: 2.1 time: 0.156753 Aug 28 10:22:41.186594 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 365/710] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:41 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:41.997171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8cc964ee-0f97-458b-932c-7fe123d1aeef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:41.997708 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-8cc964ee-0f97-458b-932c-7fe123d1aeef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:41.999582 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=4 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:22:42.000301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=22 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:22:42.006753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8cc964ee-0f97-458b-932c-7fe123d1aeef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:42.007231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8cc964ee-0f97-458b-932c-7fe123d1aeef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:42.007657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8cc964ee-0f97-458b-932c-7fe123d1aeef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:42.008339 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8cc964ee-0f97-458b-932c-7fe123d1aeef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:42.008810 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8cc964ee-0f97-458b-932c-7fe123d1aeef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:42.009223 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8cc964ee-0f97-458b-932c-7fe123d1aeef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:42.148673 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8cc964ee-0f97-458b-932c-7fe123d1aeef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:42.158119 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8cc964ee-0f97-458b-932c-7fe123d1aeef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:42.159725 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8cc964ee-0f97-458b-932c-7fe123d1aeef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:42.161059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-8cc964ee-0f97-458b-932c-7fe123d1aeef tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1405 microversion: 2.20 time: 0.167951 Aug 28 10:22:42.161617 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 346/711] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:22:41 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:22:42.207270 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e75150a9-b5b7-42b9-8315-a9e1e672306c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:42.207875 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e75150a9-b5b7-42b9-8315-a9e1e672306c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:42.214920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e75150a9-b5b7-42b9-8315-a9e1e672306c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:42.215382 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e75150a9-b5b7-42b9-8315-a9e1e672306c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:42.215803 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e75150a9-b5b7-42b9-8315-a9e1e672306c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:42.216478 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e75150a9-b5b7-42b9-8315-a9e1e672306c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:42.216947 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e75150a9-b5b7-42b9-8315-a9e1e672306c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:42.217356 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e75150a9-b5b7-42b9-8315-a9e1e672306c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:42.344522 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e75150a9-b5b7-42b9-8315-a9e1e672306c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:42.354755 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e75150a9-b5b7-42b9-8315-a9e1e672306c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1677 microversion: 2.1 time: 0.151463 Aug 28 10:22:42.360558 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 366/712] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:42 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:43.183268 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-7e87f4bf-91c5-4748-9be6-0a17a25e8f54 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:43.183976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-7e87f4bf-91c5-4748-9be6-0a17a25e8f54 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:43.190670 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7e87f4bf-91c5-4748-9be6-0a17a25e8f54 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:43.191104 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7e87f4bf-91c5-4748-9be6-0a17a25e8f54 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:43.191519 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7e87f4bf-91c5-4748-9be6-0a17a25e8f54 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:43.192199 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7e87f4bf-91c5-4748-9be6-0a17a25e8f54 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:43.192666 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7e87f4bf-91c5-4748-9be6-0a17a25e8f54 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:43.193079 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7e87f4bf-91c5-4748-9be6-0a17a25e8f54 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:43.310351 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bb88090f-9b73-4290-bd3a-279e9f91f0fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1049677977", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-413008888", "security_groups": [{"name": "tempest-secgroup-smoke-42242114"}], "block_device_mapping_v2": [{"uuid": "41f18a79-fc21-4450-888d-0c6a77eb7686", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "90d5e7eb-f02c-47a7-8a0d-74e76461cf4f"}]}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:22:43.335110 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7e87f4bf-91c5-4748-9be6-0a17a25e8f54 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:43.343646 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7e87f4bf-91c5-4748-9be6-0a17a25e8f54 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:43.345102 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7e87f4bf-91c5-4748-9be6-0a17a25e8f54 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:43.346199 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-7e87f4bf-91c5-4748-9be6-0a17a25e8f54 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1405 microversion: 2.20 time: 0.166936 Aug 28 10:22:43.346753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 347/713] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:22:43 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:22:43.375239 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f1589b3f-6e31-4ac5-a9e8-6e3d2c18d337 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:43.375832 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f1589b3f-6e31-4ac5-a9e8-6e3d2c18d337 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:43.382075 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f1589b3f-6e31-4ac5-a9e8-6e3d2c18d337 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:43.382553 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f1589b3f-6e31-4ac5-a9e8-6e3d2c18d337 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:43.382973 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f1589b3f-6e31-4ac5-a9e8-6e3d2c18d337 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:43.383682 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f1589b3f-6e31-4ac5-a9e8-6e3d2c18d337 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:43.384218 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f1589b3f-6e31-4ac5-a9e8-6e3d2c18d337 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:43.384680 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f1589b3f-6e31-4ac5-a9e8-6e3d2c18d337 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:43.434898 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-bb88090f-9b73-4290-bd3a-279e9f91f0fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] validate_networks() for [('90d5e7eb-f02c-47a7-8a0d-74e76461cf4f', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 28 10:22:43.603957 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f1589b3f-6e31-4ac5-a9e8-6e3d2c18d337 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:43.612344 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f1589b3f-6e31-4ac5-a9e8-6e3d2c18d337 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1677 microversion: 2.1 time: 0.240930 Aug 28 10:22:43.620007 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 348/714] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:43 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1677 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:43.752288 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-4c08cf60-81c1-4db8-ab60-04a47e67e10b req-07f52cb8-95ef-482b-a16f-cf49deca4b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6960433f-4e91-4c5b-9c8e-50645b6e13e7", "name": "network-vif-plugged", "status": "completed", "tag": "609522cc-a982-46e3-bc01-474519fee148"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:22:43.763861 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-4c08cf60-81c1-4db8-ab60-04a47e67e10b req-07f52cb8-95ef-482b-a16f-cf49deca4b33 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:43.764642 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-4c08cf60-81c1-4db8-ab60-04a47e67e10b req-07f52cb8-95ef-482b-a16f-cf49deca4b33 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:43.765276 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-4c08cf60-81c1-4db8-ab60-04a47e67e10b req-07f52cb8-95ef-482b-a16f-cf49deca4b33 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:43.780671 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-4c08cf60-81c1-4db8-ab60-04a47e67e10b req-07f52cb8-95ef-482b-a16f-cf49deca4b33 service nova] Creating event network-vif-plugged:609522cc-a982-46e3-bc01-474519fee148 for instance 6960433f-4e91-4c5b-9c8e-50645b6e13e7 on hv-cinder-85200 Aug 28 10:22:43.785863 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-4c08cf60-81c1-4db8-ab60-04a47e67e10b req-07f52cb8-95ef-482b-a16f-cf49deca4b33 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037697 Aug 28 10:22:43.786464 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 349/715] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:22:43.917522 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-bb88090f-9b73-4290-bd3a-279e9f91f0fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 28 10:22:43.918043 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-bb88090f-9b73-4290-bd3a-279e9f91f0fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 28 10:22:43.919189 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-bb88090f-9b73-4290-bd3a-279e9f91f0fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 28 10:22:43.919805 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-bb88090f-9b73-4290-bd3a-279e9f91f0fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 28 10:22:43.920211 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-bb88090f-9b73-4290-bd3a-279e9f91f0fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 28 10:22:43.929328 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb88090f-9b73-4290-bd3a-279e9f91f0fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:43.929734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb88090f-9b73-4290-bd3a-279e9f91f0fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:43.930158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb88090f-9b73-4290-bd3a-279e9f91f0fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:43.930862 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb88090f-9b73-4290-bd3a-279e9f91f0fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:43.931485 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb88090f-9b73-4290-bd3a-279e9f91f0fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:43.931986 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb88090f-9b73-4290-bd3a-279e9f91f0fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:43.951509 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-bb88090f-9b73-4290-bd3a-279e9f91f0fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Getting quotas for project af70fccdef544a499725509ccd8c545f. Resources: {'instances', 'cores', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:22:43.955449 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-bb88090f-9b73-4290-bd3a-279e9f91f0fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Getting quotas for user 3deb7adb33004f1097574470754611ec and project af70fccdef544a499725509ccd8c545f. Resources: {'instances', 'cores', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:22:44.012794 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bb88090f-9b73-4290-bd3a-279e9f91f0fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 28 10:22:44.014995 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bb88090f-9b73-4290-bd3a-279e9f91f0fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='41f18a79-fc21-4450-888d-0c6a77eb7686',volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 28 10:22:44.151004 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bb88090f-9b73-4290-bd3a-279e9f91f0fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.844517 Aug 28 10:22:44.151645 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 367/716] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Aug 28 10:22:43 2022] POST /compute/v2.1/servers => generated 404 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 28 10:22:44.164626 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-fd345366-ea9c-4928-86e2-8ef20cfb2bd6 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:44.165393 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-fd345366-ea9c-4928-86e2-8ef20cfb2bd6 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:44.224919 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-fd345366-ea9c-4928-86e2-8ef20cfb2bd6 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:44.232888 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-fd345366-ea9c-4928-86e2-8ef20cfb2bd6 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b" status: 200 len: 1094 microversion: 2.1 time: 0.073202 Aug 28 10:22:44.233641 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 350/717] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:44 2022] GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:44.369311 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2d9d5213-37aa-4263-82c9-78a8988fb8a7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:44.369945 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2d9d5213-37aa-4263-82c9-78a8988fb8a7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:44.375990 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d9d5213-37aa-4263-82c9-78a8988fb8a7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:44.376465 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d9d5213-37aa-4263-82c9-78a8988fb8a7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:44.376918 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d9d5213-37aa-4263-82c9-78a8988fb8a7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:44.377593 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d9d5213-37aa-4263-82c9-78a8988fb8a7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:44.378027 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d9d5213-37aa-4263-82c9-78a8988fb8a7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:44.378436 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d9d5213-37aa-4263-82c9-78a8988fb8a7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:44.508981 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2d9d5213-37aa-4263-82c9-78a8988fb8a7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:44.518153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2d9d5213-37aa-4263-82c9-78a8988fb8a7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:44.519726 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2d9d5213-37aa-4263-82c9-78a8988fb8a7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:44.521095 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2d9d5213-37aa-4263-82c9-78a8988fb8a7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1405 microversion: 2.20 time: 0.156297 Aug 28 10:22:44.521781 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 368/718] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:22:44 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:22:44.637505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-046207a6-df92-4945-be2f-0f9d9d41961d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:44.638160 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-046207a6-df92-4945-be2f-0f9d9d41961d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:44.645120 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-046207a6-df92-4945-be2f-0f9d9d41961d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:44.645698 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-046207a6-df92-4945-be2f-0f9d9d41961d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:44.646196 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-046207a6-df92-4945-be2f-0f9d9d41961d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:44.647135 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-046207a6-df92-4945-be2f-0f9d9d41961d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:44.647656 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-046207a6-df92-4945-be2f-0f9d9d41961d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:44.648297 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-046207a6-df92-4945-be2f-0f9d9d41961d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:44.779338 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-046207a6-df92-4945-be2f-0f9d9d41961d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:44.787603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-046207a6-df92-4945-be2f-0f9d9d41961d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1677 microversion: 2.1 time: 0.156847 Aug 28 10:22:44.788184 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 351/719] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:44 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:45.253554 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a97a88b9-6247-4b22-921a-7f56d270ac65 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:45.254174 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a97a88b9-6247-4b22-921a-7f56d270ac65 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:45.260686 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a97a88b9-6247-4b22-921a-7f56d270ac65 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:45.261276 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a97a88b9-6247-4b22-921a-7f56d270ac65 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:45.261750 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a97a88b9-6247-4b22-921a-7f56d270ac65 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:45.262765 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a97a88b9-6247-4b22-921a-7f56d270ac65 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:45.263344 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a97a88b9-6247-4b22-921a-7f56d270ac65 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:45.263753 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a97a88b9-6247-4b22-921a-7f56d270ac65 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:45.330592 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a97a88b9-6247-4b22-921a-7f56d270ac65 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:45.338347 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a97a88b9-6247-4b22-921a-7f56d270ac65 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b" status: 200 len: 1136 microversion: 2.1 time: 0.088736 Aug 28 10:22:45.338921 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 369/720] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:45 2022] GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b => generated 1136 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:45.550360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-903a5114-ada5-49ac-953d-46b0d894831e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:45.552020 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-903a5114-ada5-49ac-953d-46b0d894831e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:45.561984 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-903a5114-ada5-49ac-953d-46b0d894831e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:45.562683 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-903a5114-ada5-49ac-953d-46b0d894831e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:45.563292 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-903a5114-ada5-49ac-953d-46b0d894831e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:45.564266 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-903a5114-ada5-49ac-953d-46b0d894831e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:45.564949 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-903a5114-ada5-49ac-953d-46b0d894831e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:45.565556 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-903a5114-ada5-49ac-953d-46b0d894831e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:45.705152 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-903a5114-ada5-49ac-953d-46b0d894831e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:45.713769 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-903a5114-ada5-49ac-953d-46b0d894831e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:45.715194 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-903a5114-ada5-49ac-953d-46b0d894831e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:45.716298 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-903a5114-ada5-49ac-953d-46b0d894831e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1405 microversion: 2.20 time: 0.171599 Aug 28 10:22:45.716930 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 352/721] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:22:45 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:22:45.811932 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-59c9e38a-2ebb-4968-ac17-0eb83522cfd5 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:45.812858 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-59c9e38a-2ebb-4968-ac17-0eb83522cfd5 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:45.823105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-59c9e38a-2ebb-4968-ac17-0eb83522cfd5 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:45.823826 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-59c9e38a-2ebb-4968-ac17-0eb83522cfd5 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:45.824470 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-59c9e38a-2ebb-4968-ac17-0eb83522cfd5 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:45.825544 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-59c9e38a-2ebb-4968-ac17-0eb83522cfd5 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:45.826221 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-59c9e38a-2ebb-4968-ac17-0eb83522cfd5 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:45.826848 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-59c9e38a-2ebb-4968-ac17-0eb83522cfd5 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:45.961620 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-59c9e38a-2ebb-4968-ac17-0eb83522cfd5 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:45.969772 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-59c9e38a-2ebb-4968-ac17-0eb83522cfd5 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1677 microversion: 2.1 time: 0.163661 Aug 28 10:22:45.970352 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 370/722] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:45 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:46.362989 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-307bacfa-e96f-46fc-966a-b4e2a1d37b81 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:46.363989 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-307bacfa-e96f-46fc-966a-b4e2a1d37b81 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:46.374568 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-307bacfa-e96f-46fc-966a-b4e2a1d37b81 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:46.375362 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-307bacfa-e96f-46fc-966a-b4e2a1d37b81 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:46.376071 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-307bacfa-e96f-46fc-966a-b4e2a1d37b81 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:46.377244 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-307bacfa-e96f-46fc-966a-b4e2a1d37b81 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:46.377990 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-307bacfa-e96f-46fc-966a-b4e2a1d37b81 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:46.378688 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-307bacfa-e96f-46fc-966a-b4e2a1d37b81 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:46.460374 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-307bacfa-e96f-46fc-966a-b4e2a1d37b81 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:46.471270 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-307bacfa-e96f-46fc-966a-b4e2a1d37b81 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b" status: 200 len: 1192 microversion: 2.1 time: 0.114630 Aug 28 10:22:46.472006 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 353/723] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:46 2022] GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b => generated 1192 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:46.738634 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-788d97e8-58ae-4263-8601-c0b7c8fc2e8d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:46.739260 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-788d97e8-58ae-4263-8601-c0b7c8fc2e8d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:46.745735 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-788d97e8-58ae-4263-8601-c0b7c8fc2e8d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:46.746214 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-788d97e8-58ae-4263-8601-c0b7c8fc2e8d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:46.746639 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-788d97e8-58ae-4263-8601-c0b7c8fc2e8d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:46.747413 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-788d97e8-58ae-4263-8601-c0b7c8fc2e8d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:46.747877 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-788d97e8-58ae-4263-8601-c0b7c8fc2e8d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:46.748300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-788d97e8-58ae-4263-8601-c0b7c8fc2e8d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:46.889015 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-788d97e8-58ae-4263-8601-c0b7c8fc2e8d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:46.897644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-788d97e8-58ae-4263-8601-c0b7c8fc2e8d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:46.899219 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-788d97e8-58ae-4263-8601-c0b7c8fc2e8d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:46.900956 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-788d97e8-58ae-4263-8601-c0b7c8fc2e8d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1597 microversion: 2.20 time: 0.166259 Aug 28 10:22:46.901520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 371/724] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:22:46 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1597 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:22:46.924253 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-61cdd072-24cf-4b4d-a184-831566e097ba tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:46.924779 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-61cdd072-24cf-4b4d-a184-831566e097ba tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:46.930876 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61cdd072-24cf-4b4d-a184-831566e097ba tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:46.931347 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61cdd072-24cf-4b4d-a184-831566e097ba tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:46.931915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61cdd072-24cf-4b4d-a184-831566e097ba tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:46.932627 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61cdd072-24cf-4b4d-a184-831566e097ba tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:46.933197 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61cdd072-24cf-4b4d-a184-831566e097ba tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:46.933610 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61cdd072-24cf-4b4d-a184-831566e097ba tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:46.990904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6efe8adc-4449-4f18-9b6a-7583fae25e26 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:46.991623 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6efe8adc-4449-4f18-9b6a-7583fae25e26 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:46.998788 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6efe8adc-4449-4f18-9b6a-7583fae25e26 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:46.999396 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6efe8adc-4449-4f18-9b6a-7583fae25e26 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:47.000074 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6efe8adc-4449-4f18-9b6a-7583fae25e26 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:47.001004 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6efe8adc-4449-4f18-9b6a-7583fae25e26 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:47.001592 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6efe8adc-4449-4f18-9b6a-7583fae25e26 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:47.002114 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6efe8adc-4449-4f18-9b6a-7583fae25e26 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:47.015834 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-61cdd072-24cf-4b4d-a184-831566e097ba tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096265 Aug 28 10:22:47.016557 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 354/725] 10.222.0.40 () {60 vars in 1316 bytes} [Sun Aug 28 10:22:46 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 28 10:22:47.293202 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6efe8adc-4449-4f18-9b6a-7583fae25e26 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:47.301559 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6efe8adc-4449-4f18-9b6a-7583fae25e26 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1677 microversion: 2.1 time: 0.315223 Aug 28 10:22:47.302346 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 372/726] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:46 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1677 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:22:47.494357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4764e41e-cc72-4c26-833e-81c8a26a2410 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:47.495443 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4764e41e-cc72-4c26-833e-81c8a26a2410 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:47.503726 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4764e41e-cc72-4c26-833e-81c8a26a2410 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:47.504478 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4764e41e-cc72-4c26-833e-81c8a26a2410 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:47.505170 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4764e41e-cc72-4c26-833e-81c8a26a2410 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:47.506050 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4764e41e-cc72-4c26-833e-81c8a26a2410 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:47.506643 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4764e41e-cc72-4c26-833e-81c8a26a2410 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:47.507376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4764e41e-cc72-4c26-833e-81c8a26a2410 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:48.003312 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-b034e142-f227-439e-824a-c8d44ccf7f62 req-a24cde2f-8c81-4f8f-ac84-f754c55ae708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b", "tag": "680e36a2-6344-4ef9-89ec-012960185e19"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:22:48.022538 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-b034e142-f227-439e-824a-c8d44ccf7f62 req-a24cde2f-8c81-4f8f-ac84-f754c55ae708 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:48.023458 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-b034e142-f227-439e-824a-c8d44ccf7f62 req-a24cde2f-8c81-4f8f-ac84-f754c55ae708 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:48.023942 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-b034e142-f227-439e-824a-c8d44ccf7f62 req-a24cde2f-8c81-4f8f-ac84-f754c55ae708 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:48.028413 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:22:48.037104 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-b034e142-f227-439e-824a-c8d44ccf7f62 req-a24cde2f-8c81-4f8f-ac84-f754c55ae708 service nova] Creating event network-changed:680e36a2-6344-4ef9-89ec-012960185e19 for instance 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b on hv-cinder-85200 Aug 28 10:22:48.041292 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4764e41e-cc72-4c26-833e-81c8a26a2410 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:48.042806 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-b034e142-f227-439e-824a-c8d44ccf7f62 req-a24cde2f-8c81-4f8f-ac84-f754c55ae708 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042792 Aug 28 10:22:48.044075 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 373/727] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:22:48.054356 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4764e41e-cc72-4c26-833e-81c8a26a2410 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b" status: 200 len: 1276 microversion: 2.1 time: 0.563829 Aug 28 10:22:48.062295 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 355/728] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:47 2022] GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b => generated 1276 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:48.324982 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-90d9c2e8-31e3-4e05-97c1-8bd5a6e16359 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:48.328083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-90d9c2e8-31e3-4e05-97c1-8bd5a6e16359 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:48.341730 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-90d9c2e8-31e3-4e05-97c1-8bd5a6e16359 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:48.342219 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-90d9c2e8-31e3-4e05-97c1-8bd5a6e16359 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:48.342651 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-90d9c2e8-31e3-4e05-97c1-8bd5a6e16359 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:48.343354 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-90d9c2e8-31e3-4e05-97c1-8bd5a6e16359 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:48.343801 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-90d9c2e8-31e3-4e05-97c1-8bd5a6e16359 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:48.344215 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-90d9c2e8-31e3-4e05-97c1-8bd5a6e16359 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:48.527300 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-0b06c361-df0c-4986-9ebf-c83e6ecb00bb req-bb79f911-894a-4085-bc9b-fe3b2cc7e4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6960433f-4e91-4c5b-9c8e-50645b6e13e7", "tag": "609522cc-a982-46e3-bc01-474519fee148"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:22:48.537157 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-90d9c2e8-31e3-4e05-97c1-8bd5a6e16359 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:48.538384 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-0b06c361-df0c-4986-9ebf-c83e6ecb00bb req-bb79f911-894a-4085-bc9b-fe3b2cc7e4e6 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:48.538854 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-0b06c361-df0c-4986-9ebf-c83e6ecb00bb req-bb79f911-894a-4085-bc9b-fe3b2cc7e4e6 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:48.539323 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-0b06c361-df0c-4986-9ebf-c83e6ecb00bb req-bb79f911-894a-4085-bc9b-fe3b2cc7e4e6 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:48.546338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-90d9c2e8-31e3-4e05-97c1-8bd5a6e16359 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1677 microversion: 2.1 time: 0.227021 Aug 28 10:22:48.547512 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 374/729] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:48 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1677 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:48.551545 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-0b06c361-df0c-4986-9ebf-c83e6ecb00bb req-bb79f911-894a-4085-bc9b-fe3b2cc7e4e6 service nova] Creating event network-changed:609522cc-a982-46e3-bc01-474519fee148 for instance 6960433f-4e91-4c5b-9c8e-50645b6e13e7 on hv-cinder-85200 Aug 28 10:22:48.556727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-0b06c361-df0c-4986-9ebf-c83e6ecb00bb req-bb79f911-894a-4085-bc9b-fe3b2cc7e4e6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033963 Aug 28 10:22:48.557302 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 356/730] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:22:49.082424 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-63c8b2f3-7117-4d48-b010-ae38c9e9f14f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:49.083006 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-63c8b2f3-7117-4d48-b010-ae38c9e9f14f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:49.089804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-63c8b2f3-7117-4d48-b010-ae38c9e9f14f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:49.090285 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-63c8b2f3-7117-4d48-b010-ae38c9e9f14f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:49.090701 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-63c8b2f3-7117-4d48-b010-ae38c9e9f14f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:49.091385 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-63c8b2f3-7117-4d48-b010-ae38c9e9f14f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:49.091851 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-63c8b2f3-7117-4d48-b010-ae38c9e9f14f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:49.092474 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-63c8b2f3-7117-4d48-b010-ae38c9e9f14f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:49.229142 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-63c8b2f3-7117-4d48-b010-ae38c9e9f14f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:49.237201 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-63c8b2f3-7117-4d48-b010-ae38c9e9f14f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b" status: 200 len: 1264 microversion: 2.1 time: 0.158833 Aug 28 10:22:49.237824 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 375/731] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:49 2022] GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:49.568707 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-61e32808-9cab-46e9-8a15-8c630ff1214e tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:49.569470 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-61e32808-9cab-46e9-8a15-8c630ff1214e tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:49.576680 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61e32808-9cab-46e9-8a15-8c630ff1214e tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:49.577281 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61e32808-9cab-46e9-8a15-8c630ff1214e tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:49.577588 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61e32808-9cab-46e9-8a15-8c630ff1214e tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:49.578293 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61e32808-9cab-46e9-8a15-8c630ff1214e tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:49.578751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61e32808-9cab-46e9-8a15-8c630ff1214e tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:49.579169 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61e32808-9cab-46e9-8a15-8c630ff1214e tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:49.714775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-61e32808-9cab-46e9-8a15-8c630ff1214e tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:49.728714 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-61e32808-9cab-46e9-8a15-8c630ff1214e tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1677 microversion: 2.1 time: 0.165056 Aug 28 10:22:49.729286 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 357/732] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:49 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:50.257655 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9e5e5fbb-8fc4-4061-b423-3feeb1b6be98 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:50.258228 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9e5e5fbb-8fc4-4061-b423-3feeb1b6be98 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:50.264813 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e5e5fbb-8fc4-4061-b423-3feeb1b6be98 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:50.265287 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e5e5fbb-8fc4-4061-b423-3feeb1b6be98 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:50.265754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e5e5fbb-8fc4-4061-b423-3feeb1b6be98 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:50.266435 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e5e5fbb-8fc4-4061-b423-3feeb1b6be98 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:50.266850 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e5e5fbb-8fc4-4061-b423-3feeb1b6be98 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:50.267321 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e5e5fbb-8fc4-4061-b423-3feeb1b6be98 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:50.417820 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9e5e5fbb-8fc4-4061-b423-3feeb1b6be98 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:50.426233 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9e5e5fbb-8fc4-4061-b423-3feeb1b6be98 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b" status: 200 len: 1264 microversion: 2.1 time: 0.172427 Aug 28 10:22:50.426842 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 376/733] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:50 2022] GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:50.750270 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4626381c-bc14-4913-9c6f-023023379be0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:50.750850 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4626381c-bc14-4913-9c6f-023023379be0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:50.757834 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4626381c-bc14-4913-9c6f-023023379be0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:50.758309 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4626381c-bc14-4913-9c6f-023023379be0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:50.758925 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4626381c-bc14-4913-9c6f-023023379be0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:50.759732 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4626381c-bc14-4913-9c6f-023023379be0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:50.760212 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4626381c-bc14-4913-9c6f-023023379be0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:50.760663 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4626381c-bc14-4913-9c6f-023023379be0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:50.889422 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4626381c-bc14-4913-9c6f-023023379be0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:50.900955 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4626381c-bc14-4913-9c6f-023023379be0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1677 microversion: 2.1 time: 0.154538 Aug 28 10:22:50.901699 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 358/734] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:50 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:51.448812 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-36bc233c-01ab-4ddd-8ffb-e23c87ae5a7b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:51.449460 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-36bc233c-01ab-4ddd-8ffb-e23c87ae5a7b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:51.456654 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-36bc233c-01ab-4ddd-8ffb-e23c87ae5a7b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:51.457160 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-36bc233c-01ab-4ddd-8ffb-e23c87ae5a7b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:51.457591 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-36bc233c-01ab-4ddd-8ffb-e23c87ae5a7b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:51.458310 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-36bc233c-01ab-4ddd-8ffb-e23c87ae5a7b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:51.458783 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-36bc233c-01ab-4ddd-8ffb-e23c87ae5a7b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:51.459224 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-36bc233c-01ab-4ddd-8ffb-e23c87ae5a7b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:51.590940 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-36bc233c-01ab-4ddd-8ffb-e23c87ae5a7b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:51.598943 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-36bc233c-01ab-4ddd-8ffb-e23c87ae5a7b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b" status: 200 len: 1264 microversion: 2.1 time: 0.154985 Aug 28 10:22:51.599548 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 377/735] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:51 2022] GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:51.931574 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-949c1642-110d-4e4c-8b18-c7d06e4d1960 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:51.932448 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-949c1642-110d-4e4c-8b18-c7d06e4d1960 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:51.941216 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-949c1642-110d-4e4c-8b18-c7d06e4d1960 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:51.941849 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-949c1642-110d-4e4c-8b18-c7d06e4d1960 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:51.942410 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-949c1642-110d-4e4c-8b18-c7d06e4d1960 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:51.943311 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-949c1642-110d-4e4c-8b18-c7d06e4d1960 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:51.943908 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-949c1642-110d-4e4c-8b18-c7d06e4d1960 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:51.944459 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-949c1642-110d-4e4c-8b18-c7d06e4d1960 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:52.083422 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-949c1642-110d-4e4c-8b18-c7d06e4d1960 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:52.091266 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-949c1642-110d-4e4c-8b18-c7d06e4d1960 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1654 microversion: 2.1 time: 0.166212 Aug 28 10:22:52.091847 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 359/736] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:51 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1654 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:52.111800 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fd80e708-ba33-4301-8687-8782144846bc tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:22:52.117959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd80e708-ba33-4301-8687-8782144846bc tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:52.118434 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd80e708-ba33-4301-8687-8782144846bc tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:52.118890 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd80e708-ba33-4301-8687-8782144846bc tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:52.142814 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fd80e708-ba33-4301-8687-8782144846bc tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Going to try to start instance {{(pid=120663) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 28 10:22:52.190230 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fd80e708-ba33-4301-8687-8782144846bc tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "POST /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f/action" status: 202 len: 0 microversion: 2.1 time: 0.081998 Aug 28 10:22:52.190730 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 378/737] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Aug 28 10:22:52 2022] POST /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:22:52.199072 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-b9940528-6f98-4edb-a917-8b913d1c9998 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:52.199676 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-b9940528-6f98-4edb-a917-8b913d1c9998 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:52.205718 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b9940528-6f98-4edb-a917-8b913d1c9998 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:52.206193 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b9940528-6f98-4edb-a917-8b913d1c9998 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:52.206612 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b9940528-6f98-4edb-a917-8b913d1c9998 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:52.207325 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b9940528-6f98-4edb-a917-8b913d1c9998 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:52.207765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b9940528-6f98-4edb-a917-8b913d1c9998 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:52.208179 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b9940528-6f98-4edb-a917-8b913d1c9998 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:52.335541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-b9940528-6f98-4edb-a917-8b913d1c9998 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:52.343630 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-b9940528-6f98-4edb-a917-8b913d1c9998 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1663 microversion: 2.1 time: 0.148434 Aug 28 10:22:52.344211 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 360/738] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:52 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1663 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:52.622131 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ad272536-c86a-4a39-92a9-7c55d3f1fcf1 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:52.622820 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ad272536-c86a-4a39-92a9-7c55d3f1fcf1 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:52.629315 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ad272536-c86a-4a39-92a9-7c55d3f1fcf1 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:52.629785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ad272536-c86a-4a39-92a9-7c55d3f1fcf1 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:52.630206 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ad272536-c86a-4a39-92a9-7c55d3f1fcf1 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:52.630888 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ad272536-c86a-4a39-92a9-7c55d3f1fcf1 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:52.631325 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ad272536-c86a-4a39-92a9-7c55d3f1fcf1 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:52.631734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ad272536-c86a-4a39-92a9-7c55d3f1fcf1 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:52.765966 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ad272536-c86a-4a39-92a9-7c55d3f1fcf1 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:52.773761 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ad272536-c86a-4a39-92a9-7c55d3f1fcf1 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b" status: 200 len: 1264 microversion: 2.1 time: 0.156434 Aug 28 10:22:52.774428 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 379/739] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:52 2022] GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:53.365365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-649dcb3e-0e6d-43ea-8fa6-e87c0d22e7ed tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:53.365903 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-649dcb3e-0e6d-43ea-8fa6-e87c0d22e7ed tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:53.372935 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-649dcb3e-0e6d-43ea-8fa6-e87c0d22e7ed tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:53.373408 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-649dcb3e-0e6d-43ea-8fa6-e87c0d22e7ed tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:53.373829 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-649dcb3e-0e6d-43ea-8fa6-e87c0d22e7ed tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:53.374510 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-649dcb3e-0e6d-43ea-8fa6-e87c0d22e7ed tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:53.374953 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-649dcb3e-0e6d-43ea-8fa6-e87c0d22e7ed tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:53.375362 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-649dcb3e-0e6d-43ea-8fa6-e87c0d22e7ed tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:53.378003 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=100 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:22:53.507779 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-649dcb3e-0e6d-43ea-8fa6-e87c0d22e7ed tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:53.517068 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-649dcb3e-0e6d-43ea-8fa6-e87c0d22e7ed tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1663 microversion: 2.1 time: 0.155617 Aug 28 10:22:53.517646 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 361/740] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:53 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1663 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:53.796548 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a77d8758-6fef-4fa7-a4e6-d0df9b7e162c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:53.797337 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a77d8758-6fef-4fa7-a4e6-d0df9b7e162c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:53.805298 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a77d8758-6fef-4fa7-a4e6-d0df9b7e162c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:53.805855 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a77d8758-6fef-4fa7-a4e6-d0df9b7e162c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:53.806350 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a77d8758-6fef-4fa7-a4e6-d0df9b7e162c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:53.807183 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a77d8758-6fef-4fa7-a4e6-d0df9b7e162c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:53.807772 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a77d8758-6fef-4fa7-a4e6-d0df9b7e162c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:53.808235 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a77d8758-6fef-4fa7-a4e6-d0df9b7e162c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:53.940559 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:22:53.945147 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a77d8758-6fef-4fa7-a4e6-d0df9b7e162c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:53.953196 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a77d8758-6fef-4fa7-a4e6-d0df9b7e162c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b" status: 200 len: 1264 microversion: 2.1 time: 0.161634 Aug 28 10:22:53.953776 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 380/741] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:53 2022] GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:54.538527 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-589e714c-43e0-4b7b-b226-e21e2c163afa tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:54.539138 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-589e714c-43e0-4b7b-b226-e21e2c163afa tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:54.541126 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=2 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:22:54.547405 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-589e714c-43e0-4b7b-b226-e21e2c163afa tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:54.547881 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-589e714c-43e0-4b7b-b226-e21e2c163afa tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:54.548304 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-589e714c-43e0-4b7b-b226-e21e2c163afa tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:54.549022 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-589e714c-43e0-4b7b-b226-e21e2c163afa tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:54.549461 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-589e714c-43e0-4b7b-b226-e21e2c163afa tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:54.549881 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-589e714c-43e0-4b7b-b226-e21e2c163afa tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:54.690105 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-589e714c-43e0-4b7b-b226-e21e2c163afa tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:54.698355 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-589e714c-43e0-4b7b-b226-e21e2c163afa tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1667 microversion: 2.1 time: 0.163831 Aug 28 10:22:54.698894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 362/742] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:54 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1667 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:54.977928 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d32720e7-17c3-40bd-a551-a17978fd60a7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:54.978933 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d32720e7-17c3-40bd-a551-a17978fd60a7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:54.981841 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=6 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:22:54.991662 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d32720e7-17c3-40bd-a551-a17978fd60a7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:54.992453 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d32720e7-17c3-40bd-a551-a17978fd60a7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:54.993212 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d32720e7-17c3-40bd-a551-a17978fd60a7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:54.994352 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d32720e7-17c3-40bd-a551-a17978fd60a7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:54.994797 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d32720e7-17c3-40bd-a551-a17978fd60a7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:54.995212 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d32720e7-17c3-40bd-a551-a17978fd60a7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:55.135539 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d32720e7-17c3-40bd-a551-a17978fd60a7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:55.143755 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d32720e7-17c3-40bd-a551-a17978fd60a7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b" status: 200 len: 1264 microversion: 2.1 time: 0.172401 Aug 28 10:22:55.144334 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 381/743] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:54 2022] GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:56.168402 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-140a68e4-3806-49fb-a5cb-0a00129c861f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:56.169033 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-140a68e4-3806-49fb-a5cb-0a00129c861f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:56.175719 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-140a68e4-3806-49fb-a5cb-0a00129c861f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:56.176197 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-140a68e4-3806-49fb-a5cb-0a00129c861f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:56.176659 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-140a68e4-3806-49fb-a5cb-0a00129c861f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:56.177350 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-140a68e4-3806-49fb-a5cb-0a00129c861f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:56.177806 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-140a68e4-3806-49fb-a5cb-0a00129c861f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:56.178207 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-140a68e4-3806-49fb-a5cb-0a00129c861f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:56.313593 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-140a68e4-3806-49fb-a5cb-0a00129c861f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:56.325958 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-140a68e4-3806-49fb-a5cb-0a00129c861f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b" status: 200 len: 1264 microversion: 2.1 time: 0.163173 Aug 28 10:22:56.326695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 363/744] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:56 2022] GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:57.354543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d872a97e-58ff-481d-8bfd-288dc1a08580 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:57.355242 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d872a97e-58ff-481d-8bfd-288dc1a08580 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:57.362225 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d872a97e-58ff-481d-8bfd-288dc1a08580 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:57.362710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d872a97e-58ff-481d-8bfd-288dc1a08580 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:57.363139 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d872a97e-58ff-481d-8bfd-288dc1a08580 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:57.363826 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d872a97e-58ff-481d-8bfd-288dc1a08580 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:57.364279 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d872a97e-58ff-481d-8bfd-288dc1a08580 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:57.364733 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d872a97e-58ff-481d-8bfd-288dc1a08580 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:57.495453 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d872a97e-58ff-481d-8bfd-288dc1a08580 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:57.503667 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d872a97e-58ff-481d-8bfd-288dc1a08580 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b" status: 200 len: 1264 microversion: 2.1 time: 0.155189 Aug 28 10:22:57.504252 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 382/745] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:57 2022] GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:58.524161 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-77b0b5a7-311c-4b89-b857-a5fd461d273d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:58.524781 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-77b0b5a7-311c-4b89-b857-a5fd461d273d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:58.531350 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-77b0b5a7-311c-4b89-b857-a5fd461d273d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:58.531938 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-77b0b5a7-311c-4b89-b857-a5fd461d273d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:58.532434 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-77b0b5a7-311c-4b89-b857-a5fd461d273d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:58.533223 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-77b0b5a7-311c-4b89-b857-a5fd461d273d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:58.533739 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-77b0b5a7-311c-4b89-b857-a5fd461d273d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:58.534229 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-77b0b5a7-311c-4b89-b857-a5fd461d273d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:58.680272 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-77b0b5a7-311c-4b89-b857-a5fd461d273d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:58.688267 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-77b0b5a7-311c-4b89-b857-a5fd461d273d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b" status: 200 len: 1264 microversion: 2.1 time: 0.168050 Aug 28 10:22:58.689141 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 364/746] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:58 2022] GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:22:59.709640 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7ce0cce9-5d22-4661-95ec-e22a41da2ef9 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:22:59.710389 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7ce0cce9-5d22-4661-95ec-e22a41da2ef9 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:22:59.719977 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ce0cce9-5d22-4661-95ec-e22a41da2ef9 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:59.720860 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ce0cce9-5d22-4661-95ec-e22a41da2ef9 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:59.721465 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ce0cce9-5d22-4661-95ec-e22a41da2ef9 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:59.722259 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ce0cce9-5d22-4661-95ec-e22a41da2ef9 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:59.722833 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ce0cce9-5d22-4661-95ec-e22a41da2ef9 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:59.723607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ce0cce9-5d22-4661-95ec-e22a41da2ef9 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:59.835542 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-6a52180e-2d2d-4970-8ed7-d5d2f3a5607b req-65fe9a4e-7fcf-4360-92a1-a09229bb2e92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b", "name": "network-vif-plugged", "status": "completed", "tag": "680e36a2-6344-4ef9-89ec-012960185e19"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:22:59.846434 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-6a52180e-2d2d-4970-8ed7-d5d2f3a5607b req-65fe9a4e-7fcf-4360-92a1-a09229bb2e92 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:22:59.846899 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-6a52180e-2d2d-4970-8ed7-d5d2f3a5607b req-65fe9a4e-7fcf-4360-92a1-a09229bb2e92 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:22:59.847350 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-6a52180e-2d2d-4970-8ed7-d5d2f3a5607b req-65fe9a4e-7fcf-4360-92a1-a09229bb2e92 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:22:59.859704 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-6a52180e-2d2d-4970-8ed7-d5d2f3a5607b req-65fe9a4e-7fcf-4360-92a1-a09229bb2e92 service nova] Creating event network-vif-plugged:680e36a2-6344-4ef9-89ec-012960185e19 for instance 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b on hv-cinder-85200 Aug 28 10:22:59.865197 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-6a52180e-2d2d-4970-8ed7-d5d2f3a5607b req-65fe9a4e-7fcf-4360-92a1-a09229bb2e92 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033693 Aug 28 10:22:59.865576 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7ce0cce9-5d22-4661-95ec-e22a41da2ef9 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:22:59.866088 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 365/747] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:22:59.874035 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7ce0cce9-5d22-4661-95ec-e22a41da2ef9 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b" status: 200 len: 1264 microversion: 2.1 time: 0.169054 Aug 28 10:22:59.874622 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 383/748] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:22:59 2022] GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:23:00.899588 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4e845d21-279c-42b9-964b-af0ecbb174fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:00.900652 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4e845d21-279c-42b9-964b-af0ecbb174fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:23:00.907696 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4e845d21-279c-42b9-964b-af0ecbb174fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:00.908172 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4e845d21-279c-42b9-964b-af0ecbb174fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:00.908646 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4e845d21-279c-42b9-964b-af0ecbb174fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:00.909328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4e845d21-279c-42b9-964b-af0ecbb174fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:00.909799 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4e845d21-279c-42b9-964b-af0ecbb174fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:00.910239 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4e845d21-279c-42b9-964b-af0ecbb174fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:01.040883 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4e845d21-279c-42b9-964b-af0ecbb174fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:23:01.049590 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4e845d21-279c-42b9-964b-af0ecbb174fc tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b" status: 200 len: 1264 microversion: 2.1 time: 0.156978 Aug 28 10:23:01.050144 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 366/749] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:23:00 2022] GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:23:02.070230 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7358e492-a2c2-4f35-b9c9-b2dd25261eed tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:02.070839 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7358e492-a2c2-4f35-b9c9-b2dd25261eed tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:23:02.077621 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7358e492-a2c2-4f35-b9c9-b2dd25261eed tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:02.078106 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7358e492-a2c2-4f35-b9c9-b2dd25261eed tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:02.078538 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7358e492-a2c2-4f35-b9c9-b2dd25261eed tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:02.079224 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7358e492-a2c2-4f35-b9c9-b2dd25261eed tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:02.079677 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7358e492-a2c2-4f35-b9c9-b2dd25261eed tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:02.080103 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7358e492-a2c2-4f35-b9c9-b2dd25261eed tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:02.227787 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7358e492-a2c2-4f35-b9c9-b2dd25261eed tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:23:02.238295 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7358e492-a2c2-4f35-b9c9-b2dd25261eed tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b" status: 200 len: 1451 microversion: 2.1 time: 0.171712 Aug 28 10:23:02.239086 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 384/750] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:23:02 2022] GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b => generated 1451 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:23:02.260697 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-29f7bc3f-9c94-4b13-8760-8faf6bce8034 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:02.261285 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-29f7bc3f-9c94-4b13-8760-8faf6bce8034 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:23:02.263808 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=69 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:23:02.269225 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-29f7bc3f-9c94-4b13-8760-8faf6bce8034 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:02.269697 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-29f7bc3f-9c94-4b13-8760-8faf6bce8034 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:02.270124 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-29f7bc3f-9c94-4b13-8760-8faf6bce8034 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:02.270805 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-29f7bc3f-9c94-4b13-8760-8faf6bce8034 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:02.271252 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-29f7bc3f-9c94-4b13-8760-8faf6bce8034 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:02.271661 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-29f7bc3f-9c94-4b13-8760-8faf6bce8034 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:02.412844 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-29f7bc3f-9c94-4b13-8760-8faf6bce8034 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:23:02.421428 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-29f7bc3f-9c94-4b13-8760-8faf6bce8034 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b" status: 200 len: 1451 microversion: 2.1 time: 0.164613 Aug 28 10:23:02.421999 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 367/751] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:23:02 2022] GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:23:04.137290 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-84274ac6-2a01-4003-987d-f1438cf73210 req-37fff015-4fc0-4abc-8b54-da086bfb173d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b", "tag": "680e36a2-6344-4ef9-89ec-012960185e19"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:23:04.147330 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-84274ac6-2a01-4003-987d-f1438cf73210 req-37fff015-4fc0-4abc-8b54-da086bfb173d service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:04.147879 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-84274ac6-2a01-4003-987d-f1438cf73210 req-37fff015-4fc0-4abc-8b54-da086bfb173d service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:04.148442 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-84274ac6-2a01-4003-987d-f1438cf73210 req-37fff015-4fc0-4abc-8b54-da086bfb173d service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:04.160095 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-84274ac6-2a01-4003-987d-f1438cf73210 req-37fff015-4fc0-4abc-8b54-da086bfb173d service nova] Creating event network-changed:680e36a2-6344-4ef9-89ec-012960185e19 for instance 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b on hv-cinder-85200 Aug 28 10:23:04.165660 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-84274ac6-2a01-4003-987d-f1438cf73210 req-37fff015-4fc0-4abc-8b54-da086bfb173d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032149 Aug 28 10:23:04.166239 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 385/752] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:23:19.498565 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-690264cb-7fe9-423b-af9c-b4423b874362 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:19.499098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-690264cb-7fe9-423b-af9c-b4423b874362 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:23:19.501642 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=1 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:23:19.502291 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=37 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:23:19.507787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-690264cb-7fe9-423b-af9c-b4423b874362 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:19.508265 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-690264cb-7fe9-423b-af9c-b4423b874362 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:19.508728 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-690264cb-7fe9-423b-af9c-b4423b874362 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:19.509418 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-690264cb-7fe9-423b-af9c-b4423b874362 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:19.509870 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-690264cb-7fe9-423b-af9c-b4423b874362 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:19.510293 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-690264cb-7fe9-423b-af9c-b4423b874362 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:19.597971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.objects.instance [None req-690264cb-7fe9-423b-af9c-b4423b874362 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lazy-loading 'services' on Instance uuid c652c0fc-a515-4755-9eb4-8d46727fe990 {{(pid=120664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:23:19.680190 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-690264cb-7fe9-423b-af9c-b4423b874362 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990/os-volume_attachments/55a867c7-4149-45b3-95d5-8c95e39153b8" status: 202 len: 0 microversion: 2.1 time: 0.187264 Aug 28 10:23:19.681060 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 368/753] 10.222.0.40 () {58 vars in 1416 bytes} [Sun Aug 28 10:23:19 2022] DELETE /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990/os-volume_attachments/55a867c7-4149-45b3-95d5-8c95e39153b8 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:23:19.687998 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:23:19.688770 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:23:19.693682 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-91e01c45-34b9-4d6d-a727-7375cd6edd08 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:19.695910 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-91e01c45-34b9-4d6d-a727-7375cd6edd08 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:23:19.704611 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91e01c45-34b9-4d6d-a727-7375cd6edd08 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:19.705081 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91e01c45-34b9-4d6d-a727-7375cd6edd08 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:19.705672 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91e01c45-34b9-4d6d-a727-7375cd6edd08 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:19.706524 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91e01c45-34b9-4d6d-a727-7375cd6edd08 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:19.707195 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91e01c45-34b9-4d6d-a727-7375cd6edd08 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:19.707660 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91e01c45-34b9-4d6d-a727-7375cd6edd08 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:19.741348 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-91e01c45-34b9-4d6d-a727-7375cd6edd08 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054803 Aug 28 10:23:19.741915 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 386/754] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Aug 28 10:23:19 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:23:20.756254 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-94bbfb85-dc23-4567-8ca1-504ce296da13 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:20.758703 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-94bbfb85-dc23-4567-8ca1-504ce296da13 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:23:20.765212 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-94bbfb85-dc23-4567-8ca1-504ce296da13 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:20.765688 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-94bbfb85-dc23-4567-8ca1-504ce296da13 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:20.766112 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-94bbfb85-dc23-4567-8ca1-504ce296da13 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:20.766801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-94bbfb85-dc23-4567-8ca1-504ce296da13 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:20.767243 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-94bbfb85-dc23-4567-8ca1-504ce296da13 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:20.767681 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-94bbfb85-dc23-4567-8ca1-504ce296da13 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:20.799053 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-94bbfb85-dc23-4567-8ca1-504ce296da13 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048372 Aug 28 10:23:20.799615 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 369/755] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Aug 28 10:23:20 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 28 10:23:20.871366 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3b6177b6-4f99-43db-8a1d-a752cdb793b2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:20.871985 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3b6177b6-4f99-43db-8a1d-a752cdb793b2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:23:20.878352 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b6177b6-4f99-43db-8a1d-a752cdb793b2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:20.878822 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b6177b6-4f99-43db-8a1d-a752cdb793b2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:20.879245 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b6177b6-4f99-43db-8a1d-a752cdb793b2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:20.880137 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b6177b6-4f99-43db-8a1d-a752cdb793b2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:20.880616 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b6177b6-4f99-43db-8a1d-a752cdb793b2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:20.881034 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b6177b6-4f99-43db-8a1d-a752cdb793b2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:20.906251 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3b6177b6-4f99-43db-8a1d-a752cdb793b2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 28 10:23:20.998852 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3b6177b6-4f99-43db-8a1d-a752cdb793b2 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 204 len: 0 microversion: 2.1 time: 0.131047 Aug 28 10:23:20.999636 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 387/756] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:23:20 2022] DELETE /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 28 10:23:21.008865 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-d7ed9868-607f-484c-b7eb-9684ed0ab034 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:21.009506 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-d7ed9868-607f-484c-b7eb-9684ed0ab034 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:23:21.015987 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d7ed9868-607f-484c-b7eb-9684ed0ab034 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:21.016467 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d7ed9868-607f-484c-b7eb-9684ed0ab034 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:21.016920 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d7ed9868-607f-484c-b7eb-9684ed0ab034 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:21.017606 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d7ed9868-607f-484c-b7eb-9684ed0ab034 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:21.018060 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d7ed9868-607f-484c-b7eb-9684ed0ab034 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:21.018478 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d7ed9868-607f-484c-b7eb-9684ed0ab034 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:21.152274 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d7ed9868-607f-484c-b7eb-9684ed0ab034 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:23:21.161075 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-d7ed9868-607f-484c-b7eb-9684ed0ab034 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1689 microversion: 2.1 time: 0.156347 Aug 28 10:23:21.161739 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 370/757] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:23:21 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:23:22.194687 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a6c0be33-d71e-40e8-8f97-bb5d10a1a602 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:22.195795 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a6c0be33-d71e-40e8-8f97-bb5d10a1a602 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:23:22.204588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a6c0be33-d71e-40e8-8f97-bb5d10a1a602 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:22.205085 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a6c0be33-d71e-40e8-8f97-bb5d10a1a602 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:22.205513 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a6c0be33-d71e-40e8-8f97-bb5d10a1a602 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:22.206197 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a6c0be33-d71e-40e8-8f97-bb5d10a1a602 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:22.206640 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a6c0be33-d71e-40e8-8f97-bb5d10a1a602 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:22.207055 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a6c0be33-d71e-40e8-8f97-bb5d10a1a602 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:22.342829 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a6c0be33-d71e-40e8-8f97-bb5d10a1a602 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:23:22.354891 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a6c0be33-d71e-40e8-8f97-bb5d10a1a602 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1689 microversion: 2.1 time: 0.167110 Aug 28 10:23:22.355661 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 388/758] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:23:22 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:23:23.378443 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-16e6268a-73ea-4094-9a88-1107f7641e2c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:23.380616 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-16e6268a-73ea-4094-9a88-1107f7641e2c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:23:23.387609 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-16e6268a-73ea-4094-9a88-1107f7641e2c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:23.388088 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-16e6268a-73ea-4094-9a88-1107f7641e2c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:23.388550 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-16e6268a-73ea-4094-9a88-1107f7641e2c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:23.389229 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-16e6268a-73ea-4094-9a88-1107f7641e2c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:23.389673 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-16e6268a-73ea-4094-9a88-1107f7641e2c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:23.390089 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-16e6268a-73ea-4094-9a88-1107f7641e2c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:23.525939 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-16e6268a-73ea-4094-9a88-1107f7641e2c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:23:23.533890 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-16e6268a-73ea-4094-9a88-1107f7641e2c tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1689 microversion: 2.1 time: 0.159909 Aug 28 10:23:23.534459 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 371/759] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:23:23 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:23:24.559254 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6ca23c32-7ad8-41a2-bfa8-10e0bf5ba9f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:24.560204 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6ca23c32-7ad8-41a2-bfa8-10e0bf5ba9f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:23:24.571242 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ca23c32-7ad8-41a2-bfa8-10e0bf5ba9f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:24.572020 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ca23c32-7ad8-41a2-bfa8-10e0bf5ba9f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:24.572785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ca23c32-7ad8-41a2-bfa8-10e0bf5ba9f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:24.573905 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ca23c32-7ad8-41a2-bfa8-10e0bf5ba9f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:24.574638 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ca23c32-7ad8-41a2-bfa8-10e0bf5ba9f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:24.575319 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ca23c32-7ad8-41a2-bfa8-10e0bf5ba9f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:24.715860 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6ca23c32-7ad8-41a2-bfa8-10e0bf5ba9f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:23:24.724027 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6ca23c32-7ad8-41a2-bfa8-10e0bf5ba9f4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1689 microversion: 2.1 time: 0.171272 Aug 28 10:23:24.724595 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 389/760] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:23:24 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:23:25.711809 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-2af52916-50c2-4945-b73e-17fe15e90df3 req-f4d12f1c-a82c-4c4b-a056-200706535709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c652c0fc-a515-4755-9eb4-8d46727fe990", "name": "network-vif-deleted", "tag": "3db4dcbc-3ec6-4d01-8d04-71f8a8b8b4b0"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:23:25.723623 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-2af52916-50c2-4945-b73e-17fe15e90df3 req-f4d12f1c-a82c-4c4b-a056-200706535709 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:25.724197 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-2af52916-50c2-4945-b73e-17fe15e90df3 req-f4d12f1c-a82c-4c4b-a056-200706535709 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:25.724826 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-2af52916-50c2-4945-b73e-17fe15e90df3 req-f4d12f1c-a82c-4c4b-a056-200706535709 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:25.737109 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-2af52916-50c2-4945-b73e-17fe15e90df3 req-f4d12f1c-a82c-4c4b-a056-200706535709 service nova] Creating event network-vif-deleted:3db4dcbc-3ec6-4d01-8d04-71f8a8b8b4b0 for instance c652c0fc-a515-4755-9eb4-8d46727fe990 on hv-cinder-85200 Aug 28 10:23:25.745165 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f2467d99-44ab-4476-baed-f9f5fcb26f7e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:25.745816 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f2467d99-44ab-4476-baed-f9f5fcb26f7e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:23:25.746733 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-2af52916-50c2-4945-b73e-17fe15e90df3 req-f4d12f1c-a82c-4c4b-a056-200706535709 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038787 Aug 28 10:23:25.747913 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 372/761] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:23:25.753401 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f2467d99-44ab-4476-baed-f9f5fcb26f7e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:25.753879 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f2467d99-44ab-4476-baed-f9f5fcb26f7e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:25.754302 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f2467d99-44ab-4476-baed-f9f5fcb26f7e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:25.755217 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f2467d99-44ab-4476-baed-f9f5fcb26f7e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:25.755454 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f2467d99-44ab-4476-baed-f9f5fcb26f7e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:25.757350 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f2467d99-44ab-4476-baed-f9f5fcb26f7e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:25.831497 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f2467d99-44ab-4476-baed-f9f5fcb26f7e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:23:25.839939 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f2467d99-44ab-4476-baed-f9f5fcb26f7e tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 200 len: 1331 microversion: 2.1 time: 0.098781 Aug 28 10:23:25.840926 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 390/762] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:23:25 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:23:26.861496 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f7ac97b0-3476-4cda-ae0d-8723f6930a27 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:26.862187 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f7ac97b0-3476-4cda-ae0d-8723f6930a27 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c652c0fc-a515-4755-9eb4-8d46727fe990] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:23:26.868661 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f7ac97b0-3476-4cda-ae0d-8723f6930a27 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:26.869162 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f7ac97b0-3476-4cda-ae0d-8723f6930a27 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:26.869623 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f7ac97b0-3476-4cda-ae0d-8723f6930a27 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:26.870325 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f7ac97b0-3476-4cda-ae0d-8723f6930a27 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:26.870767 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f7ac97b0-3476-4cda-ae0d-8723f6930a27 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:26.871187 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f7ac97b0-3476-4cda-ae0d-8723f6930a27 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:26.885711 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-f7ac97b0-3476-4cda-ae0d-8723f6930a27 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] HTTP exception thrown: Instance c652c0fc-a515-4755-9eb4-8d46727fe990 could not be found. Aug 28 10:23:26.888334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f7ac97b0-3476-4cda-ae0d-8723f6930a27 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Request method failure captured: Aug 28 10:23:26.888334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 HTTP/1.1 Aug 28 10:23:26.888334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:23:26.888334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:23:26.888334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:23:26.888334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:23:26.888334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:23:26.888334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:23:26.888334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:23:26.888334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:23:26.888334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0BdyAqhvO99cOM5hawKKYVu196vZNrBZRhFt1ByTfBso6IljPvRwmFtOxQ-5_REe3e3fIpeo_Uxe0JjEGytZ3lwxFlupsGmsBRkrCJVUAkjaIvPOzsCZzFrWjagztbQkpAi3Bsz_osgpmcHtCpoXF-xdis5QSWY4NN8aMRzRAADM90 Aug 28 10:23:26.888334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:23:26.888334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:23:26.888334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:23:26.888334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:23:26.888334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:23:26.888334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:23:26.888334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: 76d489fb3d144cc3abf03a842e70636d Aug 28 10:23:26.888334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-925139782 Aug 28 10:23:26.888334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:23:26.888334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:23:26.889769 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_76d489fb3d144cc3abf03a842e70636d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/76d489fb3d144cc3abf03a842e70636d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/76d489fb3d144cc3abf03a842e70636d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/76d489fb3d144cc3abf03a842e70636d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:23:26.889769 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-ServerRescueNegativeTestJSON-925139782 Aug 28 10:23:26.889769 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: 76d489fb3d144cc3abf03a842e70636d Aug 28 10:23:26.889769 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-925139782 Aug 28 10:23:26.889769 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-ServerRescueNegativeTestJSON-925139782-project Aug 28 10:23:26.889769 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:23:26.889769 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:23:26.889769 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: edbf26fde0254259a540f31139fc1a51 Aug 28 10:23:26.889769 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-ServerRescueNegativeTestJSON-925139782-project Aug 28 10:23:26.889769 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: > Aug 28 10:23:26.889769 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Instance c652c0fc-a515-4755-9eb4-8d46727fe990 could not be found. Aug 28 10:23:26.889769 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': 'c652c0fc-a515-4755-9eb4-8d46727fe990'} Aug 28 10:23:26.890864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:23:26.890864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:23:26.890864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:23:26.890864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:23:26.890864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:23:26.890864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:23:26.890864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:23:26.890864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:23:26.890864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:23:26.890864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:23:26.890864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c652c0fc-a515-4755-9eb4-8d46727fe990 could not be found. Aug 28 10:23:26.890864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:23:26.890864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:23:26.890864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:23:26.890864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:23:26.890864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:23:26.890864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:23:26.890864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:23:26.890864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:23:26.890864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:23:26.892376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:23:26.892376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:23:26.892376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:23:26.892376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:23:26.892376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:23:26.892376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:23:26.892376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:23:26.892376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c652c0fc-a515-4755-9eb4-8d46727fe990 could not be found. Aug 28 10:23:26.892376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:23:26.892376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:23:26.892376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:23:26.892376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:23:26.892376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:23:26.892376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:23:26.892376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:23:26.892376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:23:26.892376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c652c0fc-a515-4755-9eb4-8d46727fe990 could not be found. Aug 28 10:23:26.892376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:23:26.893568 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f7ac97b0-3476-4cda-ae0d-8723f6930a27 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Returning 404 to user: Instance c652c0fc-a515-4755-9eb4-8d46727fe990 could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:23:26.894176 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f7ac97b0-3476-4cda-ae0d-8723f6930a27 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990" status: 404 len: 111 microversion: 2.1 time: 0.037621 Aug 28 10:23:26.894949 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 373/763] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:23:26 2022] GET /compute/v2.1/servers/c652c0fc-a515-4755-9eb4-8d46727fe990 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 28 10:23:26.902852 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5753f352-e3c2-4a14-a670-caa98d706925 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '.version_select at 0x7f7a1c1bc040>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:26.923495 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5753f352-e3c2-4a14-a670-caa98d706925 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1399682061" status: 202 len: 0 microversion: 2.1 time: 0.024392 Aug 28 10:23:26.924069 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 391/764] 10.222.0.40 () {58 vars in 1221 bytes} [Sun Aug 28 10:23:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1399682061 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:23:30.010902 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-977470fb-8523-40cf-96ab-4da3806e41c4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:30.011402 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-977470fb-8523-40cf-96ab-4da3806e41c4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:23:30.017810 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-977470fb-8523-40cf-96ab-4da3806e41c4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:30.018277 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-977470fb-8523-40cf-96ab-4da3806e41c4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:30.018702 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-977470fb-8523-40cf-96ab-4da3806e41c4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:30.019377 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-977470fb-8523-40cf-96ab-4da3806e41c4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:30.019829 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-977470fb-8523-40cf-96ab-4da3806e41c4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:30.020223 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-977470fb-8523-40cf-96ab-4da3806e41c4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:30.045454 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-977470fb-8523-40cf-96ab-4da3806e41c4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Going to try to terminate instance {{(pid=120664) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 28 10:23:30.123305 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-977470fb-8523-40cf-96ab-4da3806e41c4 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 204 len: 0 microversion: 2.1 time: 0.116055 Aug 28 10:23:30.124150 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 374/765] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:23:30 2022] DELETE /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 28 10:23:30.132724 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-28ccea65-c39c-491a-bae8-b20436a19262 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:30.133355 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-28ccea65-c39c-491a-bae8-b20436a19262 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:23:30.142334 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-28ccea65-c39c-491a-bae8-b20436a19262 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:30.142795 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-28ccea65-c39c-491a-bae8-b20436a19262 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:30.143235 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-28ccea65-c39c-491a-bae8-b20436a19262 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:30.143897 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-28ccea65-c39c-491a-bae8-b20436a19262 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:30.144332 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-28ccea65-c39c-491a-bae8-b20436a19262 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:30.144789 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-28ccea65-c39c-491a-bae8-b20436a19262 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:30.275585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-28ccea65-c39c-491a-bae8-b20436a19262 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:23:30.283502 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-28ccea65-c39c-491a-bae8-b20436a19262 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1509 microversion: 2.1 time: 0.155348 Aug 28 10:23:30.284131 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 392/766] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:23:30 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:23:31.306656 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-07a75cee-89fd-43b0-aaa1-48d293ff8542 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:31.307349 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-07a75cee-89fd-43b0-aaa1-48d293ff8542 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:23:31.314100 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-07a75cee-89fd-43b0-aaa1-48d293ff8542 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:31.314583 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-07a75cee-89fd-43b0-aaa1-48d293ff8542 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:31.315013 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-07a75cee-89fd-43b0-aaa1-48d293ff8542 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:31.315977 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-07a75cee-89fd-43b0-aaa1-48d293ff8542 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:31.316668 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-07a75cee-89fd-43b0-aaa1-48d293ff8542 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:31.317244 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-07a75cee-89fd-43b0-aaa1-48d293ff8542 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:31.483173 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-07a75cee-89fd-43b0-aaa1-48d293ff8542 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:23:31.491207 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-07a75cee-89fd-43b0-aaa1-48d293ff8542 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 200 len: 1509 microversion: 2.1 time: 0.189335 Aug 28 10:23:31.492165 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 375/767] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:23:31 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:23:31.515320 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-749ab637-78a1-49df-ae46-265395d9ff5f req-0a75d540-e349-4b1c-b6d0-23eb061fe878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5016c8b-754f-45cf-b06d-a76bc62afb13", "name": "network-vif-deleted", "tag": "4ac906a4-9f4d-413f-b675-c5b1fa08afbb"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:23:31.526716 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-749ab637-78a1-49df-ae46-265395d9ff5f req-0a75d540-e349-4b1c-b6d0-23eb061fe878 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:31.527526 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-749ab637-78a1-49df-ae46-265395d9ff5f req-0a75d540-e349-4b1c-b6d0-23eb061fe878 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:31.527955 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-749ab637-78a1-49df-ae46-265395d9ff5f req-0a75d540-e349-4b1c-b6d0-23eb061fe878 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:31.539493 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-749ab637-78a1-49df-ae46-265395d9ff5f req-0a75d540-e349-4b1c-b6d0-23eb061fe878 service nova] Creating event network-vif-deleted:4ac906a4-9f4d-413f-b675-c5b1fa08afbb for instance a5016c8b-754f-45cf-b06d-a76bc62afb13 on hv-cinder-85200 Aug 28 10:23:31.545421 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-749ab637-78a1-49df-ae46-265395d9ff5f req-0a75d540-e349-4b1c-b6d0-23eb061fe878 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033432 Aug 28 10:23:31.546266 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 393/768] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:23:32.516127 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-03ea4700-faae-4a00-ba76-9a4f3569f935 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:32.516806 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-03ea4700-faae-4a00-ba76-9a4f3569f935 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: a5016c8b-754f-45cf-b06d-a76bc62afb13] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:23:32.524724 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-03ea4700-faae-4a00-ba76-9a4f3569f935 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:32.525278 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-03ea4700-faae-4a00-ba76-9a4f3569f935 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:32.525775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-03ea4700-faae-4a00-ba76-9a4f3569f935 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:32.526568 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-03ea4700-faae-4a00-ba76-9a4f3569f935 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:32.527085 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-03ea4700-faae-4a00-ba76-9a4f3569f935 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:32.527569 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-03ea4700-faae-4a00-ba76-9a4f3569f935 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:32.545792 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-03ea4700-faae-4a00-ba76-9a4f3569f935 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] HTTP exception thrown: Instance a5016c8b-754f-45cf-b06d-a76bc62afb13 could not be found. Aug 28 10:23:32.547413 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-03ea4700-faae-4a00-ba76-9a4f3569f935 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Request method failure captured: Aug 28 10:23:32.547413 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 HTTP/1.1 Aug 28 10:23:32.547413 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:23:32.547413 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:23:32.547413 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:23:32.547413 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:23:32.547413 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:23:32.547413 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:23:32.547413 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:23:32.547413 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:23:32.547413 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0BdyAqhvO99cOM5hawKKYVu196vZNrBZRhFt1ByTfBso6IljPvRwmFtOxQ-5_REe3e3fIpeo_Uxe0JjEGytZ3lwxFlupsGmsBRkrCJVUAkjaIvPOzsCZzFrWjagztbQkpAi3Bsz_osgpmcHtCpoXF-xdis5QSWY4NN8aMRzRAADM90 Aug 28 10:23:32.547413 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:23:32.547413 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:23:32.547413 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:23:32.547413 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:23:32.547413 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:23:32.547413 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:23:32.547413 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: 76d489fb3d144cc3abf03a842e70636d Aug 28 10:23:32.547413 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-925139782 Aug 28 10:23:32.547413 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:23:32.547413 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:23:32.548932 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_76d489fb3d144cc3abf03a842e70636d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/76d489fb3d144cc3abf03a842e70636d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/76d489fb3d144cc3abf03a842e70636d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/76d489fb3d144cc3abf03a842e70636d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:23:32.548932 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-ServerRescueNegativeTestJSON-925139782 Aug 28 10:23:32.548932 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: 76d489fb3d144cc3abf03a842e70636d Aug 28 10:23:32.548932 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-925139782 Aug 28 10:23:32.548932 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-ServerRescueNegativeTestJSON-925139782-project Aug 28 10:23:32.548932 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:23:32.548932 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:23:32.548932 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: edbf26fde0254259a540f31139fc1a51 Aug 28 10:23:32.548932 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-ServerRescueNegativeTestJSON-925139782-project Aug 28 10:23:32.548932 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: > Aug 28 10:23:32.548932 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Instance a5016c8b-754f-45cf-b06d-a76bc62afb13 could not be found. Aug 28 10:23:32.548932 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': 'a5016c8b-754f-45cf-b06d-a76bc62afb13'} Aug 28 10:23:32.549647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:23:32.549647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:23:32.549647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:23:32.549647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:23:32.549647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:23:32.549647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:23:32.549647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:23:32.549647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:23:32.549647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:23:32.549647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:23:32.549647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5016c8b-754f-45cf-b06d-a76bc62afb13 could not be found. Aug 28 10:23:32.549647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:23:32.549647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:23:32.549647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:23:32.549647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:23:32.549647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:23:32.549647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:23:32.549647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:23:32.549647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:23:32.549647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:23:32.550839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:23:32.550839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:23:32.550839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:23:32.550839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:23:32.550839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:23:32.550839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:23:32.550839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:23:32.550839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5016c8b-754f-45cf-b06d-a76bc62afb13 could not be found. Aug 28 10:23:32.550839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:23:32.550839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:23:32.550839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:23:32.550839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:23:32.550839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:23:32.550839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:23:32.550839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:23:32.550839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:23:32.550839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5016c8b-754f-45cf-b06d-a76bc62afb13 could not be found. Aug 28 10:23:32.550839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:23:32.552299 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-03ea4700-faae-4a00-ba76-9a4f3569f935 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Returning 404 to user: Instance a5016c8b-754f-45cf-b06d-a76bc62afb13 could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:23:32.552299 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-03ea4700-faae-4a00-ba76-9a4f3569f935 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13" status: 404 len: 111 microversion: 2.1 time: 0.038573 Aug 28 10:23:32.552299 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 376/769] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:23:32 2022] GET /compute/v2.1/servers/a5016c8b-754f-45cf-b06d-a76bc62afb13 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:23:32.558579 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-61b5b32c-8090-4b16-a836-a69526d8ae18 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:32.559146 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-61b5b32c-8090-4b16-a836-a69526d8ae18 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:23:32.565800 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-61b5b32c-8090-4b16-a836-a69526d8ae18 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:32.566284 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-61b5b32c-8090-4b16-a836-a69526d8ae18 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:32.566711 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-61b5b32c-8090-4b16-a836-a69526d8ae18 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:32.567401 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-61b5b32c-8090-4b16-a836-a69526d8ae18 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:32.567850 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-61b5b32c-8090-4b16-a836-a69526d8ae18 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:32.568269 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-61b5b32c-8090-4b16-a836-a69526d8ae18 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:32.593929 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-61b5b32c-8090-4b16-a836-a69526d8ae18 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 28 10:23:32.670741 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-61b5b32c-8090-4b16-a836-a69526d8ae18 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed" status: 204 len: 0 microversion: 2.1 time: 0.116766 Aug 28 10:23:32.671330 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 394/770] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:23:32 2022] DELETE /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 28 10:23:32.679639 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-12b777f4-4295-4c6e-8df4-9f489141cc59 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:32.680469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-12b777f4-4295-4c6e-8df4-9f489141cc59 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:23:32.686507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-12b777f4-4295-4c6e-8df4-9f489141cc59 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:32.686985 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-12b777f4-4295-4c6e-8df4-9f489141cc59 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:32.687417 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-12b777f4-4295-4c6e-8df4-9f489141cc59 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:32.688100 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-12b777f4-4295-4c6e-8df4-9f489141cc59 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:32.688576 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-12b777f4-4295-4c6e-8df4-9f489141cc59 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:32.688997 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-12b777f4-4295-4c6e-8df4-9f489141cc59 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:32.817028 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-12b777f4-4295-4c6e-8df4-9f489141cc59 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:23:32.825184 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-12b777f4-4295-4c6e-8df4-9f489141cc59 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed" status: 200 len: 1520 microversion: 2.1 time: 0.149485 Aug 28 10:23:32.825777 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 377/771] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:23:32 2022] GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:23:33.851428 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5cbd0c08-8bcc-4274-8a26-7bb0ad7c065b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:33.852440 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5cbd0c08-8bcc-4274-8a26-7bb0ad7c065b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:23:33.863349 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5cbd0c08-8bcc-4274-8a26-7bb0ad7c065b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:33.864137 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5cbd0c08-8bcc-4274-8a26-7bb0ad7c065b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:33.864922 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5cbd0c08-8bcc-4274-8a26-7bb0ad7c065b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:33.866050 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5cbd0c08-8bcc-4274-8a26-7bb0ad7c065b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:33.866790 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5cbd0c08-8bcc-4274-8a26-7bb0ad7c065b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:33.867493 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5cbd0c08-8bcc-4274-8a26-7bb0ad7c065b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:34.009589 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5cbd0c08-8bcc-4274-8a26-7bb0ad7c065b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:23:34.018194 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5cbd0c08-8bcc-4274-8a26-7bb0ad7c065b tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed" status: 200 len: 1520 microversion: 2.1 time: 0.174002 Aug 28 10:23:34.018772 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 395/772] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:23:33 2022] GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:23:35.033290 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-0f0e3b95-6c38-4f72-b4a8-e15ea38ab636 req-7155a26b-96ba-4c94-874d-92c266b5faca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c703c468-fcfc-41a1-ae56-4b9a516378ed", "name": "network-vif-deleted", "tag": "f4f9d7ba-0d95-4c3b-b146-58f4b088e007"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:23:35.044270 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-0f0e3b95-6c38-4f72-b4a8-e15ea38ab636 req-7155a26b-96ba-4c94-874d-92c266b5faca service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:35.044831 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-0f0e3b95-6c38-4f72-b4a8-e15ea38ab636 req-7155a26b-96ba-4c94-874d-92c266b5faca service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:35.045244 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-0f0e3b95-6c38-4f72-b4a8-e15ea38ab636 req-7155a26b-96ba-4c94-874d-92c266b5faca service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:35.045495 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-da607375-b2c5-4ba7-a4af-c597b12cfdb6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:35.046135 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-da607375-b2c5-4ba7-a4af-c597b12cfdb6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:23:35.053825 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da607375-b2c5-4ba7-a4af-c597b12cfdb6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:35.054316 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da607375-b2c5-4ba7-a4af-c597b12cfdb6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:35.054746 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da607375-b2c5-4ba7-a4af-c597b12cfdb6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:35.055809 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da607375-b2c5-4ba7-a4af-c597b12cfdb6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:35.056414 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da607375-b2c5-4ba7-a4af-c597b12cfdb6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:35.057091 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da607375-b2c5-4ba7-a4af-c597b12cfdb6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:35.057241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-0f0e3b95-6c38-4f72-b4a8-e15ea38ab636 req-7155a26b-96ba-4c94-874d-92c266b5faca service nova] Creating event network-vif-deleted:f4f9d7ba-0d95-4c3b-b146-58f4b088e007 for instance c703c468-fcfc-41a1-ae56-4b9a516378ed on hv-cinder-85200 Aug 28 10:23:35.063226 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-0f0e3b95-6c38-4f72-b4a8-e15ea38ab636 req-7155a26b-96ba-4c94-874d-92c266b5faca service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033414 Aug 28 10:23:35.065106 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 378/773] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:23:35.124429 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-da607375-b2c5-4ba7-a4af-c597b12cfdb6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf26fde0254259a540f31139fc1a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d489fb3d144cc3abf03a842e70636d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:23:35.132953 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-da607375-b2c5-4ba7-a4af-c597b12cfdb6 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed" status: 200 len: 1478 microversion: 2.1 time: 0.092048 Aug 28 10:23:35.133746 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 396/774] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:23:35 2022] GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed => generated 1478 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:23:36.158512 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-606dd148-788b-458d-9831-cd8c124fbb03 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:36.159375 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-606dd148-788b-458d-9831-cd8c124fbb03 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] [instance: c703c468-fcfc-41a1-ae56-4b9a516378ed] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:23:36.168258 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-606dd148-788b-458d-9831-cd8c124fbb03 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:36.168892 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-606dd148-788b-458d-9831-cd8c124fbb03 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:36.169433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-606dd148-788b-458d-9831-cd8c124fbb03 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:36.170328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-606dd148-788b-458d-9831-cd8c124fbb03 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:23:36.170897 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-606dd148-788b-458d-9831-cd8c124fbb03 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:23:36.171424 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-606dd148-788b-458d-9831-cd8c124fbb03 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:23:36.188205 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-606dd148-788b-458d-9831-cd8c124fbb03 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] HTTP exception thrown: Instance c703c468-fcfc-41a1-ae56-4b9a516378ed could not be found. Aug 28 10:23:36.189866 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-606dd148-788b-458d-9831-cd8c124fbb03 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Request method failure captured: Aug 28 10:23:36.189866 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed HTTP/1.1 Aug 28 10:23:36.189866 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:23:36.189866 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:23:36.189866 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:23:36.189866 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:23:36.189866 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:23:36.189866 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:23:36.189866 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:23:36.189866 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:23:36.189866 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0BdyAqhvO99cOM5hawKKYVu196vZNrBZRhFt1ByTfBso6IljPvRwmFtOxQ-5_REe3e3fIpeo_Uxe0JjEGytZ3lwxFlupsGmsBRkrCJVUAkjaIvPOzsCZzFrWjagztbQkpAi3Bsz_osgpmcHtCpoXF-xdis5QSWY4NN8aMRzRAADM90 Aug 28 10:23:36.189866 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:23:36.189866 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:23:36.189866 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:23:36.189866 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:23:36.189866 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:23:36.189866 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:23:36.189866 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: 76d489fb3d144cc3abf03a842e70636d Aug 28 10:23:36.189866 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-925139782 Aug 28 10:23:36.189866 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:23:36.189866 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:23:36.191336 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_76d489fb3d144cc3abf03a842e70636d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/76d489fb3d144cc3abf03a842e70636d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/76d489fb3d144cc3abf03a842e70636d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/76d489fb3d144cc3abf03a842e70636d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:23:36.191336 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-ServerRescueNegativeTestJSON-925139782 Aug 28 10:23:36.191336 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: 76d489fb3d144cc3abf03a842e70636d Aug 28 10:23:36.191336 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-925139782 Aug 28 10:23:36.191336 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-ServerRescueNegativeTestJSON-925139782-project Aug 28 10:23:36.191336 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:23:36.191336 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:23:36.191336 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: edbf26fde0254259a540f31139fc1a51 Aug 28 10:23:36.191336 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-ServerRescueNegativeTestJSON-925139782-project Aug 28 10:23:36.191336 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: > Aug 28 10:23:36.191336 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Instance c703c468-fcfc-41a1-ae56-4b9a516378ed could not be found. Aug 28 10:23:36.191336 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': 'c703c468-fcfc-41a1-ae56-4b9a516378ed'} Aug 28 10:23:36.192140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:23:36.192140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:23:36.192140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:23:36.192140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:23:36.192140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:23:36.192140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:23:36.192140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:23:36.192140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:23:36.192140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:23:36.192140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:23:36.192140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c703c468-fcfc-41a1-ae56-4b9a516378ed could not be found. Aug 28 10:23:36.192140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:23:36.192140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:23:36.192140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:23:36.192140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:23:36.192140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:23:36.192140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:23:36.192140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:23:36.192140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:23:36.192140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:23:36.193657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:23:36.193657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:23:36.193657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:23:36.193657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:23:36.193657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:23:36.193657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:23:36.193657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:23:36.193657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c703c468-fcfc-41a1-ae56-4b9a516378ed could not be found. Aug 28 10:23:36.193657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:23:36.193657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:23:36.193657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:23:36.193657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:23:36.193657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:23:36.193657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:23:36.193657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:23:36.193657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:23:36.193657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c703c468-fcfc-41a1-ae56-4b9a516378ed could not be found. Aug 28 10:23:36.193657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:23:36.194954 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-606dd148-788b-458d-9831-cd8c124fbb03 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] Returning 404 to user: Instance c703c468-fcfc-41a1-ae56-4b9a516378ed could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:23:36.194954 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-606dd148-788b-458d-9831-cd8c124fbb03 tempest-ServerRescueNegativeTestJSON-925139782 tempest-ServerRescueNegativeTestJSON-925139782-project] 10.222.0.40 "GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed" status: 404 len: 111 microversion: 2.1 time: 0.039526 Aug 28 10:23:36.194954 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 379/775] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:23:36 2022] GET /compute/v2.1/servers/c703c468-fcfc-41a1-ae56-4b9a516378ed => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:23:40.656060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-89270fed-e52d-4f92-bef2-759ecba96e0d tempest-VolumesGetTestJSON-402351550 tempest-VolumesGetTestJSON-402351550-project] Action: 'create', calling method: .version_select at 0x7f7a1c222820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-843441671", "metadata": {"Type": "work"}}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:23:40.983548 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-89270fed-e52d-4f92-bef2-759ecba96e0d tempest-VolumesGetTestJSON-402351550 tempest-VolumesGetTestJSON-402351550-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.443595 Aug 28 10:23:40.984173 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 397/776] 10.222.0.40 () {60 vars in 1156 bytes} [Sun Aug 28 10:23:40 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 445 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 28 10:23:40.996534 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-30e5a244-8f3b-4684-88a9-4476cdea7e61 tempest-VolumesGetTestJSON-402351550 tempest-VolumesGetTestJSON-402351550-project] Calling method '.version_select at 0x7f7a1c264040>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:41.046965 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-30e5a244-8f3b-4684-88a9-4476cdea7e61 tempest-VolumesGetTestJSON-402351550 tempest-VolumesGetTestJSON-402351550-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d6b08ee0-325a-4b21-a6e9-cc8711bfe7fa" status: 200 len: 352 microversion: 2.1 time: 0.054155 Aug 28 10:23:41.047643 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 380/777] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Aug 28 10:23:40 2022] GET /compute/v2.1/os-volumes/d6b08ee0-325a-4b21-a6e9-cc8711bfe7fa => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:23:42.064995 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-65e48dc4-3f35-40fa-9b56-176a31bce8ee tempest-VolumesGetTestJSON-402351550 tempest-VolumesGetTestJSON-402351550-project] Calling method '.version_select at 0x7f7a1c26e820>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:42.113519 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-65e48dc4-3f35-40fa-9b56-176a31bce8ee tempest-VolumesGetTestJSON-402351550 tempest-VolumesGetTestJSON-402351550-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d6b08ee0-325a-4b21-a6e9-cc8711bfe7fa" status: 200 len: 353 microversion: 2.1 time: 0.055241 Aug 28 10:23:42.114100 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 398/778] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Aug 28 10:23:42 2022] GET /compute/v2.1/os-volumes/d6b08ee0-325a-4b21-a6e9-cc8711bfe7fa => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:23:42.127033 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-59c17280-9d54-48eb-acb4-81de45e1bf00 tempest-VolumesGetTestJSON-402351550 tempest-VolumesGetTestJSON-402351550-project] Calling method '.version_select at 0x7f7a1c0fa4c0>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:42.177202 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-59c17280-9d54-48eb-acb4-81de45e1bf00 tempest-VolumesGetTestJSON-402351550 tempest-VolumesGetTestJSON-402351550-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d6b08ee0-325a-4b21-a6e9-cc8711bfe7fa" status: 200 len: 353 microversion: 2.1 time: 0.054187 Aug 28 10:23:42.177927 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 381/779] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Aug 28 10:23:42 2022] GET /compute/v2.1/os-volumes/d6b08ee0-325a-4b21-a6e9-cc8711bfe7fa => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:23:42.195065 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c74f052b-e3b2-45bc-85e1-73d2ba0d4037 tempest-VolumesGetTestJSON-402351550 tempest-VolumesGetTestJSON-402351550-project] Calling method '.version_select at 0x7f7a1c1b74c0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:42.259995 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c74f052b-e3b2-45bc-85e1-73d2ba0d4037 tempest-VolumesGetTestJSON-402351550 tempest-VolumesGetTestJSON-402351550-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/d6b08ee0-325a-4b21-a6e9-cc8711bfe7fa" status: 202 len: 0 microversion: 2.1 time: 0.068688 Aug 28 10:23:42.260661 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 399/780] 10.222.0.40 () {58 vars in 1248 bytes} [Sun Aug 28 10:23:42 2022] DELETE /compute/v2.1/os-volumes/d6b08ee0-325a-4b21-a6e9-cc8711bfe7fa => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:23:42.268832 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-80a3975f-b81b-4688-9d21-9de7089cc17f tempest-VolumesGetTestJSON-402351550 tempest-VolumesGetTestJSON-402351550-project] Calling method '.version_select at 0x7f7a1c13e4c0>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:42.324146 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-80a3975f-b81b-4688-9d21-9de7089cc17f tempest-VolumesGetTestJSON-402351550 tempest-VolumesGetTestJSON-402351550-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d6b08ee0-325a-4b21-a6e9-cc8711bfe7fa" status: 200 len: 352 microversion: 2.1 time: 0.059228 Aug 28 10:23:42.324778 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 382/781] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Aug 28 10:23:42 2022] GET /compute/v2.1/os-volumes/d6b08ee0-325a-4b21-a6e9-cc8711bfe7fa => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:23:43.343109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-687e5900-debb-4f74-aed1-b200abd96ffd tempest-VolumesGetTestJSON-402351550 tempest-VolumesGetTestJSON-402351550-project] Calling method '.version_select at 0x7f7a1c222d30>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:23:43.372033 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-687e5900-debb-4f74-aed1-b200abd96ffd tempest-VolumesGetTestJSON-402351550 tempest-VolumesGetTestJSON-402351550-project] HTTP exception thrown: Volume d6b08ee0-325a-4b21-a6e9-cc8711bfe7fa could not be found. Aug 28 10:23:43.374113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-687e5900-debb-4f74-aed1-b200abd96ffd tempest-VolumesGetTestJSON-402351550 tempest-VolumesGetTestJSON-402351550-project] Request method failure captured: Aug 28 10:23:43.374113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/os-volumes/d6b08ee0-325a-4b21-a6e9-cc8711bfe7fa HTTP/1.1 Aug 28 10:23:43.374113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:23:43.374113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:23:43.374113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:23:43.374113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:23:43.374113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:23:43.374113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:23:43.374113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:23:43.374113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:23:43.374113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0IsAYylgt5mbevrgxgoPpMK0TzIJc2A5XtAiFXqVg_4Q-f-Spv3Aupv4b9VUY7dTi2FES3ePGJa425HkRdIbIsNIdgnhFuGERKR8sSpGy20xjv_ZuESh74hsbBNgzLT1EVaJCpHpt0cekvHGDCQJxfds9qqEUZCavO9m8KBVHpiWkM Aug 28 10:23:43.374113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:23:43.374113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:23:43.374113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:23:43.374113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:23:43.374113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:23:43.374113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:23:43.374113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 4558b7fc3e804764b3f3e72687fb7e76 Aug 28 10:23:43.374113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesGetTestJSON-402351550 Aug 28 10:23:43.374113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:23:43.374113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:23:43.375596 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4558b7fc3e804764b3f3e72687fb7e76", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4558b7fc3e804764b3f3e72687fb7e76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4558b7fc3e804764b3f3e72687fb7e76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4558b7fc3e804764b3f3e72687fb7e76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:23:43.375596 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesGetTestJSON-402351550 Aug 28 10:23:43.375596 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 4558b7fc3e804764b3f3e72687fb7e76 Aug 28 10:23:43.375596 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesGetTestJSON-402351550 Aug 28 10:23:43.375596 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesGetTestJSON-402351550-project Aug 28 10:23:43.375596 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:23:43.375596 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:23:43.375596 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: 4b9abe14122b40a9bacab814d8b8ba11 Aug 28 10:23:43.375596 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesGetTestJSON-402351550-project Aug 28 10:23:43.375596 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: Aug 28 10:23:43.375596 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Volume d6b08ee0-325a-4b21-a6e9-cc8711bfe7fa could not be found. Aug 28 10:23:43.375596 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'id': 'd6b08ee0-325a-4b21-a6e9-cc8711bfe7fa'} Aug 28 10:23:43.375596 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:23:43.376685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:23:43.376685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 28 10:23:43.376685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 28 10:23:43.376685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 28 10:23:43.376685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 28 10:23:43.376685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 28 10:23:43.376685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 28 10:23:43.376685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 28 10:23:43.376685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 28 10:23:43.376685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 28 10:23:43.376685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 28 10:23:43.376685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 28 10:23:43.376685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 28 10:23:43.376685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 28 10:23:43.376685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 28 10:23:43.376685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d6b08ee0-325a-4b21-a6e9-cc8711bfe7fa could not be found. (HTTP 404) (Request-ID: req-fdb4ae89-8297-4581-ba91-2b5f1331a84e) Aug 28 10:23:43.376685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:23:43.376685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:23:43.376685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:23:43.378123 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:23:43.378123 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 28 10:23:43.378123 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 28 10:23:43.378123 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 28 10:23:43.378123 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 28 10:23:43.378123 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 28 10:23:43.378123 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 28 10:23:43.378123 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 28 10:23:43.378123 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 28 10:23:43.378123 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 28 10:23:43.378123 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 28 10:23:43.378123 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 28 10:23:43.378123 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 28 10:23:43.378123 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 28 10:23:43.378123 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 28 10:23:43.378123 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 28 10:23:43.378123 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 28 10:23:43.378123 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 28 10:23:43.378123 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 28 10:23:43.379539 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 28 10:23:43.379539 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 28 10:23:43.379539 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 28 10:23:43.379539 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 28 10:23:43.379539 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d6b08ee0-325a-4b21-a6e9-cc8711bfe7fa could not be found. Aug 28 10:23:43.379539 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:23:43.379539 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:23:43.379539 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:23:43.379539 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:23:43.379539 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:23:43.379539 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:23:43.379539 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:23:43.379539 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:23:43.379539 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 28 10:23:43.379539 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 28 10:23:43.379539 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:23:43.379539 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:23:43.379539 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 28 10:23:43.379539 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:23:43.381024 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d6b08ee0-325a-4b21-a6e9-cc8711bfe7fa could not be found. Aug 28 10:23:43.381024 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:23:43.381024 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:23:43.381024 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:23:43.381024 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:23:43.381024 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:23:43.381024 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:23:43.381024 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:23:43.381024 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:23:43.381024 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d6b08ee0-325a-4b21-a6e9-cc8711bfe7fa could not be found. Aug 28 10:23:43.381024 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:23:43.381024 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-687e5900-debb-4f74-aed1-b200abd96ffd tempest-VolumesGetTestJSON-402351550 tempest-VolumesGetTestJSON-402351550-project] Returning 404 to user: Volume d6b08ee0-325a-4b21-a6e9-cc8711bfe7fa could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:23:43.381024 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-687e5900-debb-4f74-aed1-b200abd96ffd tempest-VolumesGetTestJSON-402351550 tempest-VolumesGetTestJSON-402351550-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d6b08ee0-325a-4b21-a6e9-cc8711bfe7fa" status: 404 len: 109 microversion: 2.1 time: 0.039889 Aug 28 10:23:43.381024 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 400/782] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Aug 28 10:23:43 2022] GET /compute/v2.1/os-volumes/d6b08ee0-325a-4b21-a6e9-cc8711bfe7fa => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:24:03.595100 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:24:03.595862 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:24:03.600407 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-cebc52e3-5e5e-410d-bcde-1c3dfca4f85b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:03.602592 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-cebc52e3-5e5e-410d-bcde-1c3dfca4f85b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:03.610800 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cebc52e3-5e5e-410d-bcde-1c3dfca4f85b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:03.611287 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cebc52e3-5e5e-410d-bcde-1c3dfca4f85b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:03.611719 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cebc52e3-5e5e-410d-bcde-1c3dfca4f85b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:03.612408 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cebc52e3-5e5e-410d-bcde-1c3dfca4f85b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:03.612881 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cebc52e3-5e5e-410d-bcde-1c3dfca4f85b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:03.613300 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cebc52e3-5e5e-410d-bcde-1c3dfca4f85b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:03.643637 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-cebc52e3-5e5e-410d-bcde-1c3dfca4f85b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049860 Aug 28 10:24:03.644230 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 383/783] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Aug 28 10:24:03 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 28 10:24:03.704146 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:24:03.704950 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:24:03.709174 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2328e6ec-4008-4e64-8831-ef13603f749d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:03.709676 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2328e6ec-4008-4e64-8831-ef13603f749d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:03.717481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2328e6ec-4008-4e64-8831-ef13603f749d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:03.717994 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2328e6ec-4008-4e64-8831-ef13603f749d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:03.718422 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2328e6ec-4008-4e64-8831-ef13603f749d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:03.719138 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2328e6ec-4008-4e64-8831-ef13603f749d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:03.719607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2328e6ec-4008-4e64-8831-ef13603f749d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:03.720032 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2328e6ec-4008-4e64-8831-ef13603f749d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:03.749192 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2328e6ec-4008-4e64-8831-ef13603f749d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 28 10:24:03.829246 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2328e6ec-4008-4e64-8831-ef13603f749d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "DELETE /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 204 len: 0 microversion: 2.1 time: 0.126521 Aug 28 10:24:03.829898 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 401/784] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:24:03 2022] DELETE /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 28 10:24:03.839135 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-974bea3d-bc92-4454-9db7-e8aaa2755c3b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:03.839739 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-974bea3d-bc92-4454-9db7-e8aaa2755c3b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:03.846010 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-974bea3d-bc92-4454-9db7-e8aaa2755c3b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:03.846471 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-974bea3d-bc92-4454-9db7-e8aaa2755c3b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:03.846895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-974bea3d-bc92-4454-9db7-e8aaa2755c3b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:03.847577 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-974bea3d-bc92-4454-9db7-e8aaa2755c3b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:03.848015 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-974bea3d-bc92-4454-9db7-e8aaa2755c3b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:03.848431 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-974bea3d-bc92-4454-9db7-e8aaa2755c3b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:03.990859 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-974bea3d-bc92-4454-9db7-e8aaa2755c3b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:03.999201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-974bea3d-bc92-4454-9db7-e8aaa2755c3b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1673 microversion: 2.1 time: 0.164662 Aug 28 10:24:03.999799 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 384/785] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:03 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:05.025962 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-72666033-4967-41c6-a490-99d61698132b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:05.026637 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-72666033-4967-41c6-a490-99d61698132b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:05.033291 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-72666033-4967-41c6-a490-99d61698132b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:05.033767 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-72666033-4967-41c6-a490-99d61698132b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:05.034186 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-72666033-4967-41c6-a490-99d61698132b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:05.034944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-72666033-4967-41c6-a490-99d61698132b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:05.035414 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-72666033-4967-41c6-a490-99d61698132b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:05.035816 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-72666033-4967-41c6-a490-99d61698132b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:05.179994 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-72666033-4967-41c6-a490-99d61698132b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:05.187968 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-72666033-4967-41c6-a490-99d61698132b tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1673 microversion: 2.1 time: 0.168681 Aug 28 10:24:05.188538 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 402/786] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:05 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:05.797535 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4e4e2451-f195-4ae6-9d4b-e283cbfb6bbe tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:05.798130 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4e4e2451-f195-4ae6-9d4b-e283cbfb6bbe tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:05.805042 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4e4e2451-f195-4ae6-9d4b-e283cbfb6bbe tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:05.805520 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4e4e2451-f195-4ae6-9d4b-e283cbfb6bbe tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:05.805941 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4e4e2451-f195-4ae6-9d4b-e283cbfb6bbe tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:05.806744 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4e4e2451-f195-4ae6-9d4b-e283cbfb6bbe tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:05.807234 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4e4e2451-f195-4ae6-9d4b-e283cbfb6bbe tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:05.807645 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4e4e2451-f195-4ae6-9d4b-e283cbfb6bbe tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:05.831337 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4e4e2451-f195-4ae6-9d4b-e283cbfb6bbe tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346/ips" status: 200 len: 150 microversion: 2.1 time: 0.038492 Aug 28 10:24:05.831824 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 385/787] 10.222.0.40 () {58 vars in 1248 bytes} [Sun Aug 28 10:24:05 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:24:06.209476 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-eddf6c03-c20e-4252-9798-b27f630f8710 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:06.210063 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-eddf6c03-c20e-4252-9798-b27f630f8710 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:06.216578 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eddf6c03-c20e-4252-9798-b27f630f8710 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:06.217067 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eddf6c03-c20e-4252-9798-b27f630f8710 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:06.217494 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eddf6c03-c20e-4252-9798-b27f630f8710 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:06.218444 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eddf6c03-c20e-4252-9798-b27f630f8710 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:06.219110 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eddf6c03-c20e-4252-9798-b27f630f8710 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:06.219567 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eddf6c03-c20e-4252-9798-b27f630f8710 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:06.292218 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-eddf6c03-c20e-4252-9798-b27f630f8710 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:06.303214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-3ea623e0-2237-43d9-923d-9d413cdf5c08 req-12370b40-f7ce-4e8f-9ba8-3a0123974c96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71cd65ac-3099-4ac7-bf03-ed5173f6204f", "name": "network-vif-deleted", "tag": "3aeb435e-89dc-490b-b3f2-e6029500bb1d"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:24:06.310040 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-eddf6c03-c20e-4252-9798-b27f630f8710 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 200 len: 1606 microversion: 2.1 time: 0.104117 Aug 28 10:24:06.316080 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 403/788] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:06 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 1606 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:06.322670 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-3ea623e0-2237-43d9-923d-9d413cdf5c08 req-12370b40-f7ce-4e8f-9ba8-3a0123974c96 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:06.323449 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-3ea623e0-2237-43d9-923d-9d413cdf5c08 req-12370b40-f7ce-4e8f-9ba8-3a0123974c96 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:06.324098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-3ea623e0-2237-43d9-923d-9d413cdf5c08 req-12370b40-f7ce-4e8f-9ba8-3a0123974c96 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:06.336134 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-3ea623e0-2237-43d9-923d-9d413cdf5c08 req-12370b40-f7ce-4e8f-9ba8-3a0123974c96 service nova] Creating event network-vif-deleted:3aeb435e-89dc-490b-b3f2-e6029500bb1d for instance 71cd65ac-3099-4ac7-bf03-ed5173f6204f on hv-cinder-85200 Aug 28 10:24:06.342469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-3ea623e0-2237-43d9-923d-9d413cdf5c08 req-12370b40-f7ce-4e8f-9ba8-3a0123974c96 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043347 Aug 28 10:24:06.343701 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 386/789] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:24:07.189476 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-db7dd780-ea61-48a4-97fb-628fac5986d1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0dbcf961-730b-41c3-b4cb-cf1b128e8205"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:24:07.191901 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-db7dd780-ea61-48a4-97fb-628fac5986d1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:07.198067 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-db7dd780-ea61-48a4-97fb-628fac5986d1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:07.198542 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-db7dd780-ea61-48a4-97fb-628fac5986d1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:07.198969 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-db7dd780-ea61-48a4-97fb-628fac5986d1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:07.199654 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-db7dd780-ea61-48a4-97fb-628fac5986d1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:07.200096 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-db7dd780-ea61-48a4-97fb-628fac5986d1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:07.200528 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-db7dd780-ea61-48a4-97fb-628fac5986d1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:07.335588 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-abb73482-c2d0-4723-a04a-e2d50dee191a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:07.336691 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-abb73482-c2d0-4723-a04a-e2d50dee191a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:07.344483 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-abb73482-c2d0-4723-a04a-e2d50dee191a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:07.345006 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-abb73482-c2d0-4723-a04a-e2d50dee191a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:07.345414 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-abb73482-c2d0-4723-a04a-e2d50dee191a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:07.346172 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-abb73482-c2d0-4723-a04a-e2d50dee191a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:07.346810 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-abb73482-c2d0-4723-a04a-e2d50dee191a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:07.347227 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-abb73482-c2d0-4723-a04a-e2d50dee191a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:07.361736 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-abb73482-c2d0-4723-a04a-e2d50dee191a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] HTTP exception thrown: Instance 71cd65ac-3099-4ac7-bf03-ed5173f6204f could not be found. Aug 28 10:24:07.367427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-abb73482-c2d0-4723-a04a-e2d50dee191a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Request method failure captured: Aug 28 10:24:07.367427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f HTTP/1.1 Aug 28 10:24:07.367427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:24:07.367427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:24:07.367427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:24:07.367427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:24:07.367427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:24:07.367427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:24:07.367427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:24:07.367427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:24:07.367427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0DEf1QnaV9IEHCVwJGlLsWAAJdd-9F3vICUaKnR5Mxjlz-BOopu4FhPcKW0_msUYaVCZJ49WxiTbPTr16gC9M0G59NKztvPiIKQ3LlxP6QuusIFut46aa1D7uLslkDID--Y8-1bBPB0b3bzRxoZKRJIunHkfPUzFDPonfMIiEkDvs8 Aug 28 10:24:07.367427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:24:07.367427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:24:07.367427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:24:07.367427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:24:07.367427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:24:07.367427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:24:07.367427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: 0e47be8f2ac14c19ab40e293422c845d Aug 28 10:24:07.367427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-AttachVolumeTestJSON-219425345 Aug 28 10:24:07.367427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:24:07.367427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:24:07.369262 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0e47be8f2ac14c19ab40e293422c845d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e47be8f2ac14c19ab40e293422c845d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e47be8f2ac14c19ab40e293422c845d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0e47be8f2ac14c19ab40e293422c845d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:24:07.369262 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-AttachVolumeTestJSON-219425345 Aug 28 10:24:07.369262 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: 0e47be8f2ac14c19ab40e293422c845d Aug 28 10:24:07.369262 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-AttachVolumeTestJSON-219425345 Aug 28 10:24:07.369262 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-AttachVolumeTestJSON-219425345-project Aug 28 10:24:07.369262 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:24:07.369262 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:24:07.369262 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: 38a331e431394e4882f31afd31f16d46 Aug 28 10:24:07.369262 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-AttachVolumeTestJSON-219425345-project Aug 28 10:24:07.369262 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: > Aug 28 10:24:07.369262 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Instance 71cd65ac-3099-4ac7-bf03-ed5173f6204f could not be found. Aug 28 10:24:07.369262 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': '71cd65ac-3099-4ac7-bf03-ed5173f6204f'} Aug 28 10:24:07.370231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:24:07.370231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:24:07.370231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:24:07.370231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:24:07.370231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:24:07.370231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:24:07.370231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:24:07.370231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:24:07.370231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:24:07.370231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:24:07.370231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71cd65ac-3099-4ac7-bf03-ed5173f6204f could not be found. Aug 28 10:24:07.370231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:24:07.370231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:24:07.370231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:24:07.370231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:24:07.370231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:24:07.370231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:24:07.370231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:24:07.370231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:24:07.370231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:24:07.371753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:24:07.371753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:24:07.371753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:24:07.371753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:24:07.371753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:24:07.371753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:24:07.371753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:24:07.371753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71cd65ac-3099-4ac7-bf03-ed5173f6204f could not be found. Aug 28 10:24:07.371753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:24:07.371753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:24:07.371753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:24:07.371753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:24:07.371753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:24:07.371753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:24:07.371753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:24:07.371753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:24:07.371753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71cd65ac-3099-4ac7-bf03-ed5173f6204f could not be found. Aug 28 10:24:07.371753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:24:07.373261 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-abb73482-c2d0-4723-a04a-e2d50dee191a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Returning 404 to user: Instance 71cd65ac-3099-4ac7-bf03-ed5173f6204f could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:24:07.373261 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-abb73482-c2d0-4723-a04a-e2d50dee191a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 404 len: 111 microversion: 2.1 time: 0.041833 Aug 28 10:24:07.373261 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 387/790] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:07 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 28 10:24:07.379576 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8c66b4ba-2f9e-4d10-a9c5-b64801c1072f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '.version_select at 0x7f7a1c0fa0d0>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:07.403933 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-8c66b4ba-2f9e-4d10-a9c5-b64801c1072f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-315272580" status: 202 len: 0 microversion: 2.1 time: 0.027937 Aug 28 10:24:07.404668 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 388/791] 10.222.0.40 () {58 vars in 1218 bytes} [Sun Aug 28 10:24:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-315272580 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:24:07.523556 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-db7dd780-ea61-48a4-97fb-628fac5986d1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "POST /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337956 Aug 28 10:24:07.529446 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 404/792] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Aug 28 10:24:07 2022] POST /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346/os-volume_attachments => generated 194 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:24:08.397051 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-30d14c6e-c202-466c-991e-cb7f34b3e01a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Action: 'create', calling method: .version_select at 0x7f7a1c0c03a0>, body: {"keypair": {"name": "tempest-keypair-37251518", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ0JNaUpJmf74xxZPV3XAm0lUXNkNIwmOkQ9dE9+bbmIDDjLwLYDB93Txfklf6FpK4oTRTFI0cOJKpnLCDXRp6GNpOHB++Xwp0RGq5N5z2SG6/XMaYaeBqX8Nga4UCRgw=="}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:24:08.417592 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-30d14c6e-c202-466c-991e-cb7f34b3e01a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Getting quotas for project 0e47be8f2ac14c19ab40e293422c845d. Resources: {'key_pairs'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:24:08.422423 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-30d14c6e-c202-466c-991e-cb7f34b3e01a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Getting quotas for user 38a331e431394e4882f31afd31f16d46 and project 0e47be8f2ac14c19ab40e293422c845d. Resources: {'key_pairs'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:24:08.446135 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-30d14c6e-c202-466c-991e-cb7f34b3e01a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.053816 Aug 28 10:24:08.446783 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 389/793] 10.222.0.40 () {60 vars in 1159 bytes} [Sun Aug 28 10:24:08 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:24:09.766997 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-318f713b-5e44-4ea2-a979-3f16bb16f00c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-721719059", "imageRef": "2780c39b-8bd3-4e73-9669-2b2e29474f3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6f7c423-22b6-4b3c-a83a-6484427a242a"}], "security_groups": [{"name": "tempest-securitygroup--2041010314"}], "key_name": "tempest-keypair-37251518", "user_data": "}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:24:09.879971 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-318f713b-5e44-4ea2-a979-3f16bb16f00c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] validate_networks() for [('d6f7c423-22b6-4b3c-a83a-6484427a242a', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 28 10:24:10.264007 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-318f713b-5e44-4ea2-a979-3f16bb16f00c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 28 10:24:10.264359 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-318f713b-5e44-4ea2-a979-3f16bb16f00c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 28 10:24:10.264851 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-318f713b-5e44-4ea2-a979-3f16bb16f00c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 28 10:24:10.265254 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-318f713b-5e44-4ea2-a979-3f16bb16f00c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 28 10:24:10.265663 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-318f713b-5e44-4ea2-a979-3f16bb16f00c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 28 10:24:10.276997 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-318f713b-5e44-4ea2-a979-3f16bb16f00c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:10.277466 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-318f713b-5e44-4ea2-a979-3f16bb16f00c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:10.277896 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-318f713b-5e44-4ea2-a979-3f16bb16f00c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:10.278584 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-318f713b-5e44-4ea2-a979-3f16bb16f00c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:10.279033 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-318f713b-5e44-4ea2-a979-3f16bb16f00c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:10.279451 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-318f713b-5e44-4ea2-a979-3f16bb16f00c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:10.296957 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-318f713b-5e44-4ea2-a979-3f16bb16f00c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Getting quotas for project 0e47be8f2ac14c19ab40e293422c845d. Resources: {'instances', 'cores', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:24:10.301187 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-318f713b-5e44-4ea2-a979-3f16bb16f00c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Getting quotas for user 38a331e431394e4882f31afd31f16d46 and project 0e47be8f2ac14c19ab40e293422c845d. Resources: {'instances', 'cores', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:24:10.312882 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-318f713b-5e44-4ea2-a979-3f16bb16f00c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 28 10:24:10.315268 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-318f713b-5e44-4ea2-a979-3f16bb16f00c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2780c39b-8bd3-4e73-9669-2b2e29474f3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 28 10:24:10.367533 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-318f713b-5e44-4ea2-a979-3f16bb16f00c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.605595 Aug 28 10:24:10.368218 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 405/794] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Aug 28 10:24:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 28 10:24:10.379519 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f6c81938-235b-47bb-aea5-892a0f273ae8 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:10.380371 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f6c81938-235b-47bb-aea5-892a0f273ae8 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:10.438282 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f6c81938-235b-47bb-aea5-892a0f273ae8 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:10.445219 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f6c81938-235b-47bb-aea5-892a0f273ae8 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1235 microversion: 2.1 time: 0.069695 Aug 28 10:24:10.445773 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 390/795] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:10 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1235 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:11.470229 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f80fff3c-99af-41d3-b330-0c3123db7b63 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:11.471244 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f80fff3c-99af-41d3-b330-0c3123db7b63 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:11.481815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f80fff3c-99af-41d3-b330-0c3123db7b63 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:11.482290 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f80fff3c-99af-41d3-b330-0c3123db7b63 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:11.482712 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f80fff3c-99af-41d3-b330-0c3123db7b63 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:11.483397 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f80fff3c-99af-41d3-b330-0c3123db7b63 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:11.483833 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f80fff3c-99af-41d3-b330-0c3123db7b63 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:11.484250 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f80fff3c-99af-41d3-b330-0c3123db7b63 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:11.545543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f80fff3c-99af-41d3-b330-0c3123db7b63 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:11.554182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f80fff3c-99af-41d3-b330-0c3123db7b63 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1287 microversion: 2.1 time: 0.091653 Aug 28 10:24:11.554761 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 406/796] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:11 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:12.574936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-051bf53b-2c36-4043-80fd-b983f6a6d112 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:12.575554 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-051bf53b-2c36-4043-80fd-b983f6a6d112 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:12.582318 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-051bf53b-2c36-4043-80fd-b983f6a6d112 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:12.583056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-051bf53b-2c36-4043-80fd-b983f6a6d112 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:12.583846 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-051bf53b-2c36-4043-80fd-b983f6a6d112 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:12.585002 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-051bf53b-2c36-4043-80fd-b983f6a6d112 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:12.585933 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-051bf53b-2c36-4043-80fd-b983f6a6d112 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:12.586647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-051bf53b-2c36-4043-80fd-b983f6a6d112 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:12.719899 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-051bf53b-2c36-4043-80fd-b983f6a6d112 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:12.727970 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-051bf53b-2c36-4043-80fd-b983f6a6d112 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1361 microversion: 2.1 time: 0.157042 Aug 28 10:24:12.728560 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 391/797] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:12 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:12.965757 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-38971323-b140-49ff-b91a-3bb33262a5c8 req-aad0e4c6-89d1-4444-b2e9-6e80bb9b5285 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b283b4eb-2390-47c6-8b41-372447998650", "tag": "7ed5d47b-49d1-428d-a635-8a4afe3a65e4"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:24:12.975569 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-38971323-b140-49ff-b91a-3bb33262a5c8 req-aad0e4c6-89d1-4444-b2e9-6e80bb9b5285 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:12.976038 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-38971323-b140-49ff-b91a-3bb33262a5c8 req-aad0e4c6-89d1-4444-b2e9-6e80bb9b5285 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:12.976461 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-38971323-b140-49ff-b91a-3bb33262a5c8 req-aad0e4c6-89d1-4444-b2e9-6e80bb9b5285 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:12.988061 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-38971323-b140-49ff-b91a-3bb33262a5c8 req-aad0e4c6-89d1-4444-b2e9-6e80bb9b5285 service nova] Creating event network-changed:7ed5d47b-49d1-428d-a635-8a4afe3a65e4 for instance b283b4eb-2390-47c6-8b41-372447998650 on hv-cinder-85200 Aug 28 10:24:12.993550 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-38971323-b140-49ff-b91a-3bb33262a5c8 req-aad0e4c6-89d1-4444-b2e9-6e80bb9b5285 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031541 Aug 28 10:24:12.994150 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 407/798] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:24:13.750545 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-7f40b47a-45cf-459a-ac83-756f5c8753f9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:13.751123 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-7f40b47a-45cf-459a-ac83-756f5c8753f9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:13.759848 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7f40b47a-45cf-459a-ac83-756f5c8753f9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:13.760332 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7f40b47a-45cf-459a-ac83-756f5c8753f9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:13.760792 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7f40b47a-45cf-459a-ac83-756f5c8753f9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:13.761484 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7f40b47a-45cf-459a-ac83-756f5c8753f9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:13.761934 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7f40b47a-45cf-459a-ac83-756f5c8753f9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:13.762358 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7f40b47a-45cf-459a-ac83-756f5c8753f9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:13.893728 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7f40b47a-45cf-459a-ac83-756f5c8753f9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:13.901505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-7f40b47a-45cf-459a-ac83-756f5c8753f9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1361 microversion: 2.1 time: 0.155216 Aug 28 10:24:13.902072 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 392/799] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:13 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:14.923178 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7e3f9de9-cf3d-486c-9632-a2eca3f93e21 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:14.923861 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7e3f9de9-cf3d-486c-9632-a2eca3f93e21 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:14.930413 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7e3f9de9-cf3d-486c-9632-a2eca3f93e21 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:14.930928 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7e3f9de9-cf3d-486c-9632-a2eca3f93e21 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:14.931359 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7e3f9de9-cf3d-486c-9632-a2eca3f93e21 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:14.932028 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7e3f9de9-cf3d-486c-9632-a2eca3f93e21 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:14.932492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7e3f9de9-cf3d-486c-9632-a2eca3f93e21 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:14.932940 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7e3f9de9-cf3d-486c-9632-a2eca3f93e21 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:15.068882 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7e3f9de9-cf3d-486c-9632-a2eca3f93e21 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:15.076861 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7e3f9de9-cf3d-486c-9632-a2eca3f93e21 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1361 microversion: 2.1 time: 0.158860 Aug 28 10:24:15.077446 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 408/800] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:14 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:16.005594 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-132acfa5-4512-450a-9301-1354e3d78454 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:16.006334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-132acfa5-4512-450a-9301-1354e3d78454 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:16.013740 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-132acfa5-4512-450a-9301-1354e3d78454 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:16.014216 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-132acfa5-4512-450a-9301-1354e3d78454 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:16.014635 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-132acfa5-4512-450a-9301-1354e3d78454 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:16.015316 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-132acfa5-4512-450a-9301-1354e3d78454 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:16.015752 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-132acfa5-4512-450a-9301-1354e3d78454 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:16.016168 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-132acfa5-4512-450a-9301-1354e3d78454 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:16.039592 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-132acfa5-4512-450a-9301-1354e3d78454 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7/ips" status: 200 len: 152 microversion: 2.20 time: 0.038955 Aug 28 10:24:16.040311 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 393/801] 10.222.0.40 () {60 vars in 1289 bytes} [Sun Aug 28 10:24:15 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 28 10:24:16.097459 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-58a45267-e17d-4761-8a8d-1549051fa3dd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:16.098032 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-58a45267-e17d-4761-8a8d-1549051fa3dd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:16.104457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-58a45267-e17d-4761-8a8d-1549051fa3dd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:16.104967 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-58a45267-e17d-4761-8a8d-1549051fa3dd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:16.105391 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-58a45267-e17d-4761-8a8d-1549051fa3dd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:16.106080 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-58a45267-e17d-4761-8a8d-1549051fa3dd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:16.106555 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-58a45267-e17d-4761-8a8d-1549051fa3dd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:16.106967 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-58a45267-e17d-4761-8a8d-1549051fa3dd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:16.237920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-58a45267-e17d-4761-8a8d-1549051fa3dd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:16.247620 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-58a45267-e17d-4761-8a8d-1549051fa3dd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1361 microversion: 2.1 time: 0.153920 Aug 28 10:24:16.248246 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 409/802] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:16 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:24:17.271914 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e124ca0a-f72c-4378-a54e-0da11000d754 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:17.273118 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e124ca0a-f72c-4378-a54e-0da11000d754 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:17.284582 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e124ca0a-f72c-4378-a54e-0da11000d754 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:17.285309 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e124ca0a-f72c-4378-a54e-0da11000d754 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:17.286022 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e124ca0a-f72c-4378-a54e-0da11000d754 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:17.287160 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e124ca0a-f72c-4378-a54e-0da11000d754 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:17.287910 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e124ca0a-f72c-4378-a54e-0da11000d754 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:17.288623 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e124ca0a-f72c-4378-a54e-0da11000d754 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:17.423872 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-e124ca0a-f72c-4378-a54e-0da11000d754 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:17.432015 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-e124ca0a-f72c-4378-a54e-0da11000d754 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1361 microversion: 2.1 time: 0.166503 Aug 28 10:24:17.432594 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 394/803] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:17 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:18.452885 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3f2ad287-362a-424d-90f8-0575025ef14d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:18.453545 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3f2ad287-362a-424d-90f8-0575025ef14d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:18.460964 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3f2ad287-362a-424d-90f8-0575025ef14d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:18.461408 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3f2ad287-362a-424d-90f8-0575025ef14d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:18.461865 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3f2ad287-362a-424d-90f8-0575025ef14d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:18.462616 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3f2ad287-362a-424d-90f8-0575025ef14d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:18.463062 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3f2ad287-362a-424d-90f8-0575025ef14d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:18.463475 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3f2ad287-362a-424d-90f8-0575025ef14d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:18.598194 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3f2ad287-362a-424d-90f8-0575025ef14d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:18.606304 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3f2ad287-362a-424d-90f8-0575025ef14d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1361 microversion: 2.1 time: 0.157534 Aug 28 10:24:18.606851 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 410/804] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:18 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:19.003890 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-aedc87de-d466-4766-918a-b25af6876c49 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:24:19.004576 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-aedc87de-d466-4766-918a-b25af6876c49 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:19.011971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aedc87de-d466-4766-918a-b25af6876c49 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:19.012449 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aedc87de-d466-4766-918a-b25af6876c49 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:19.012937 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aedc87de-d466-4766-918a-b25af6876c49 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:19.013614 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aedc87de-d466-4766-918a-b25af6876c49 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:19.014062 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aedc87de-d466-4766-918a-b25af6876c49 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:19.014481 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aedc87de-d466-4766-918a-b25af6876c49 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:19.040885 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.objects.instance [None req-aedc87de-d466-4766-918a-b25af6876c49 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lazy-loading 'flavor' on Instance uuid 6960433f-4e91-4c5b-9c8e-50645b6e13e7 {{(pid=120664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:24:19.227435 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-aedc87de-d466-4766-918a-b25af6876c49 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "POST /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7/action" status: 202 len: 0 microversion: 2.20 time: 0.228466 Aug 28 10:24:19.228059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 395/805] 10.222.0.40 () {62 vars in 1319 bytes} [Sun Aug 28 10:24:18 2022] POST /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 28 10:24:19.236539 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c92480fb-8fd9-4a35-af7f-28e81bb24ef2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:19.237168 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c92480fb-8fd9-4a35-af7f-28e81bb24ef2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:19.243409 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c92480fb-8fd9-4a35-af7f-28e81bb24ef2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:19.243880 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c92480fb-8fd9-4a35-af7f-28e81bb24ef2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:19.244300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c92480fb-8fd9-4a35-af7f-28e81bb24ef2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:19.245014 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c92480fb-8fd9-4a35-af7f-28e81bb24ef2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:19.245452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c92480fb-8fd9-4a35-af7f-28e81bb24ef2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:19.245861 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c92480fb-8fd9-4a35-af7f-28e81bb24ef2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:19.379808 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c92480fb-8fd9-4a35-af7f-28e81bb24ef2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:19.388097 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c92480fb-8fd9-4a35-af7f-28e81bb24ef2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:19.389611 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c92480fb-8fd9-4a35-af7f-28e81bb24ef2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:19.390765 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c92480fb-8fd9-4a35-af7f-28e81bb24ef2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1722 microversion: 2.20 time: 0.158301 Aug 28 10:24:19.391316 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 411/806] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:19 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:19.627957 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-33a783ca-03a1-425f-be1b-5f64515c7e73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:19.628617 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-33a783ca-03a1-425f-be1b-5f64515c7e73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:19.635763 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-33a783ca-03a1-425f-be1b-5f64515c7e73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:19.636241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-33a783ca-03a1-425f-be1b-5f64515c7e73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:19.636714 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-33a783ca-03a1-425f-be1b-5f64515c7e73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:19.637406 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-33a783ca-03a1-425f-be1b-5f64515c7e73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:19.637854 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-33a783ca-03a1-425f-be1b-5f64515c7e73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:19.638269 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-33a783ca-03a1-425f-be1b-5f64515c7e73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:19.772643 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-33a783ca-03a1-425f-be1b-5f64515c7e73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:19.780649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-33a783ca-03a1-425f-be1b-5f64515c7e73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1361 microversion: 2.1 time: 0.157014 Aug 28 10:24:19.781217 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 396/807] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:19 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:20.414891 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-71ee66dd-0af0-4171-9bca-4b4673ceb415 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:20.415531 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-71ee66dd-0af0-4171-9bca-4b4673ceb415 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:20.419001 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:24:20.419675 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=6 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:24:20.426143 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-71ee66dd-0af0-4171-9bca-4b4673ceb415 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:20.426639 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-71ee66dd-0af0-4171-9bca-4b4673ceb415 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:20.427209 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-71ee66dd-0af0-4171-9bca-4b4673ceb415 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:20.427904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-71ee66dd-0af0-4171-9bca-4b4673ceb415 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:20.428346 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-71ee66dd-0af0-4171-9bca-4b4673ceb415 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:20.428788 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-71ee66dd-0af0-4171-9bca-4b4673ceb415 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:20.573302 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-71ee66dd-0af0-4171-9bca-4b4673ceb415 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:20.581878 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-71ee66dd-0af0-4171-9bca-4b4673ceb415 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:20.583351 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-71ee66dd-0af0-4171-9bca-4b4673ceb415 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:20.584557 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-71ee66dd-0af0-4171-9bca-4b4673ceb415 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1722 microversion: 2.20 time: 0.173562 Aug 28 10:24:20.585115 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 412/808] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:20 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:20.803594 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-173f494f-c180-4e5a-95cf-8445f9ac5903 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:20.804393 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-173f494f-c180-4e5a-95cf-8445f9ac5903 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:20.807307 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=6 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:24:20.813086 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-173f494f-c180-4e5a-95cf-8445f9ac5903 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:20.813565 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-173f494f-c180-4e5a-95cf-8445f9ac5903 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:20.813989 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-173f494f-c180-4e5a-95cf-8445f9ac5903 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:20.814674 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-173f494f-c180-4e5a-95cf-8445f9ac5903 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:20.815117 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-173f494f-c180-4e5a-95cf-8445f9ac5903 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:20.815532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-173f494f-c180-4e5a-95cf-8445f9ac5903 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:20.943935 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-173f494f-c180-4e5a-95cf-8445f9ac5903 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:20.956781 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-173f494f-c180-4e5a-95cf-8445f9ac5903 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1361 microversion: 2.1 time: 0.157995 Aug 28 10:24:20.957478 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 397/809] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:20 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:21.607620 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2d408b80-d696-470c-b3d1-12cf824d7982 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:21.608216 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2d408b80-d696-470c-b3d1-12cf824d7982 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:21.615154 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d408b80-d696-470c-b3d1-12cf824d7982 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:21.615634 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d408b80-d696-470c-b3d1-12cf824d7982 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:21.616059 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d408b80-d696-470c-b3d1-12cf824d7982 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:21.616776 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d408b80-d696-470c-b3d1-12cf824d7982 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:21.617222 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d408b80-d696-470c-b3d1-12cf824d7982 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:21.617639 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d408b80-d696-470c-b3d1-12cf824d7982 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:21.757445 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2d408b80-d696-470c-b3d1-12cf824d7982 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:21.766422 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2d408b80-d696-470c-b3d1-12cf824d7982 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:21.767853 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2d408b80-d696-470c-b3d1-12cf824d7982 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:21.769044 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2d408b80-d696-470c-b3d1-12cf824d7982 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1722 microversion: 2.20 time: 0.165453 Aug 28 10:24:21.769622 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 413/810] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:21 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:21.981056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-ef4c6a3e-81ca-4812-bb65-fcc04626cf73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:21.981747 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-ef4c6a3e-81ca-4812-bb65-fcc04626cf73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:21.990740 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ef4c6a3e-81ca-4812-bb65-fcc04626cf73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:21.991373 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ef4c6a3e-81ca-4812-bb65-fcc04626cf73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:21.991932 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ef4c6a3e-81ca-4812-bb65-fcc04626cf73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:21.992864 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ef4c6a3e-81ca-4812-bb65-fcc04626cf73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:21.993538 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ef4c6a3e-81ca-4812-bb65-fcc04626cf73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:21.994055 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ef4c6a3e-81ca-4812-bb65-fcc04626cf73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:22.136532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-ef4c6a3e-81ca-4812-bb65-fcc04626cf73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:22.144834 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-ef4c6a3e-81ca-4812-bb65-fcc04626cf73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1361 microversion: 2.1 time: 0.169832 Aug 28 10:24:22.145372 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 398/811] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:21 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:22.796445 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bbd25792-4c54-4647-9a8a-d355d04c385c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:22.797317 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bbd25792-4c54-4647-9a8a-d355d04c385c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:22.808948 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bbd25792-4c54-4647-9a8a-d355d04c385c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:22.809738 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bbd25792-4c54-4647-9a8a-d355d04c385c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:22.810446 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bbd25792-4c54-4647-9a8a-d355d04c385c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:22.811577 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bbd25792-4c54-4647-9a8a-d355d04c385c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:22.812325 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bbd25792-4c54-4647-9a8a-d355d04c385c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:22.813172 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bbd25792-4c54-4647-9a8a-d355d04c385c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:22.945570 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bbd25792-4c54-4647-9a8a-d355d04c385c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:22.957109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bbd25792-4c54-4647-9a8a-d355d04c385c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:22.958760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bbd25792-4c54-4647-9a8a-d355d04c385c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:22.960580 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bbd25792-4c54-4647-9a8a-d355d04c385c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1722 microversion: 2.20 time: 0.171136 Aug 28 10:24:22.961287 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 414/812] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:22 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:23.172570 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-ec4deca4-4825-4004-80de-963f4eab045e tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:23.173589 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-ec4deca4-4825-4004-80de-963f4eab045e tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:23.182831 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ec4deca4-4825-4004-80de-963f4eab045e tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:23.183306 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ec4deca4-4825-4004-80de-963f4eab045e tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:23.183728 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ec4deca4-4825-4004-80de-963f4eab045e tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:23.184415 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ec4deca4-4825-4004-80de-963f4eab045e tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:23.184886 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ec4deca4-4825-4004-80de-963f4eab045e tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:23.185306 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ec4deca4-4825-4004-80de-963f4eab045e tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:23.334150 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-ec4deca4-4825-4004-80de-963f4eab045e tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:23.346301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-ec4deca4-4825-4004-80de-963f4eab045e tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1361 microversion: 2.1 time: 0.181320 Aug 28 10:24:23.347273 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 399/813] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:23 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:23.985586 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c75a6243-ad8f-4bbf-b88e-f149df980544 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:23.986308 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c75a6243-ad8f-4bbf-b88e-f149df980544 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:23.995343 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c75a6243-ad8f-4bbf-b88e-f149df980544 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:23.995985 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c75a6243-ad8f-4bbf-b88e-f149df980544 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:23.996639 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c75a6243-ad8f-4bbf-b88e-f149df980544 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:23.997561 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c75a6243-ad8f-4bbf-b88e-f149df980544 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:23.998181 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c75a6243-ad8f-4bbf-b88e-f149df980544 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:23.998743 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c75a6243-ad8f-4bbf-b88e-f149df980544 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:24.134939 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c75a6243-ad8f-4bbf-b88e-f149df980544 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:24.138409 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:24:24.143812 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c75a6243-ad8f-4bbf-b88e-f149df980544 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:24.145266 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c75a6243-ad8f-4bbf-b88e-f149df980544 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:24.146404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c75a6243-ad8f-4bbf-b88e-f149df980544 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1722 microversion: 2.20 time: 0.166427 Aug 28 10:24:24.146965 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 415/814] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:23 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:24.373356 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-0e7cd77f-dc4a-4e42-abf8-6ccd3cc98f4d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:24.373946 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-0e7cd77f-dc4a-4e42-abf8-6ccd3cc98f4d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:24.381675 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0e7cd77f-dc4a-4e42-abf8-6ccd3cc98f4d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:24.383697 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0e7cd77f-dc4a-4e42-abf8-6ccd3cc98f4d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:24.383697 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0e7cd77f-dc4a-4e42-abf8-6ccd3cc98f4d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:24.383697 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0e7cd77f-dc4a-4e42-abf8-6ccd3cc98f4d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:24.384207 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0e7cd77f-dc4a-4e42-abf8-6ccd3cc98f4d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:24.384380 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0e7cd77f-dc4a-4e42-abf8-6ccd3cc98f4d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:24.514122 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-0e7cd77f-dc4a-4e42-abf8-6ccd3cc98f4d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:24.521927 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-0e7cd77f-dc4a-4e42-abf8-6ccd3cc98f4d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1361 microversion: 2.1 time: 0.152624 Aug 28 10:24:24.522536 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 400/815] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:24 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:25.170962 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1e065b23-29c3-4ed4-86e9-ebb21f9f3a6e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:25.171608 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1e065b23-29c3-4ed4-86e9-ebb21f9f3a6e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:25.180206 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e065b23-29c3-4ed4-86e9-ebb21f9f3a6e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:25.180811 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e065b23-29c3-4ed4-86e9-ebb21f9f3a6e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:25.181247 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e065b23-29c3-4ed4-86e9-ebb21f9f3a6e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:25.181971 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e065b23-29c3-4ed4-86e9-ebb21f9f3a6e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:25.182414 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e065b23-29c3-4ed4-86e9-ebb21f9f3a6e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:25.182823 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e065b23-29c3-4ed4-86e9-ebb21f9f3a6e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:25.329934 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1e065b23-29c3-4ed4-86e9-ebb21f9f3a6e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:25.339116 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1e065b23-29c3-4ed4-86e9-ebb21f9f3a6e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:25.340613 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1e065b23-29c3-4ed4-86e9-ebb21f9f3a6e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:25.341803 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1e065b23-29c3-4ed4-86e9-ebb21f9f3a6e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1722 microversion: 2.20 time: 0.175616 Aug 28 10:24:25.342573 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 416/816] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:25 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:25.543056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-7822394d-7243-4eca-b151-1f60eb4ac494 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:25.544366 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-7822394d-7243-4eca-b151-1f60eb4ac494 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:25.551273 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7822394d-7243-4eca-b151-1f60eb4ac494 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:25.551759 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7822394d-7243-4eca-b151-1f60eb4ac494 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:25.552412 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7822394d-7243-4eca-b151-1f60eb4ac494 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:25.553194 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7822394d-7243-4eca-b151-1f60eb4ac494 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:25.553642 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7822394d-7243-4eca-b151-1f60eb4ac494 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:25.554109 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7822394d-7243-4eca-b151-1f60eb4ac494 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:25.711235 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7822394d-7243-4eca-b151-1f60eb4ac494 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:25.720166 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-7822394d-7243-4eca-b151-1f60eb4ac494 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1361 microversion: 2.1 time: 0.181117 Aug 28 10:24:25.720790 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 401/817] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:25 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:25.738350 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0bae1b34-c06f-47fc-a329-669f28500812 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0dbcf961-730b-41c3-b4cb-cf1b128e8205"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:24:25.740933 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0bae1b34-c06f-47fc-a329-669f28500812 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:25.746854 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0bae1b34-c06f-47fc-a329-669f28500812 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:25.747324 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0bae1b34-c06f-47fc-a329-669f28500812 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:25.747747 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0bae1b34-c06f-47fc-a329-669f28500812 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:25.748418 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0bae1b34-c06f-47fc-a329-669f28500812 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:25.748908 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0bae1b34-c06f-47fc-a329-669f28500812 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:25.749497 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0bae1b34-c06f-47fc-a329-669f28500812 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:25.837203 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-0bae1b34-c06f-47fc-a329-669f28500812 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] HTTP exception thrown: Invalid volume: volume 0dbcf961-730b-41c3-b4cb-cf1b128e8205 is already attached to instances: b18b9c06-5718-489a-ab12-86a757322346 Aug 28 10:24:25.839153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0bae1b34-c06f-47fc-a329-669f28500812 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Request method failure captured: Aug 28 10:24:25.839153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: POST /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346/os-volume_attachments HTTP/1.1 Aug 28 10:24:25.839153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:24:25.839153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:24:25.839153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:24:25.839153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 74 Aug 28 10:24:25.839153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:24:25.839153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:24:25.839153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:24:25.839153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:24:25.839153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0BavBPfn9Wuv1kO4_4p6KYI6akLuIPAA1OxoMOfBpiurh2AuIBrDxo6hNz9wgslLyVrLvU5C-5Daa9wSWxwGejTKWsNtPvyULf4-HsU7LK2myKRcFzE4k1R7_TjPnuTN-hG4pARjml16ldcyWGxfFf1ULa1aMpcmJVMbJUsqOVrYCU Aug 28 10:24:25.839153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:24:25.839153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:24:25.839153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:24:25.839153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:24:25.839153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:24:25.839153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:24:25.839153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:24:25.839153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:24:25.839153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:24:25.839153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:24:25.841196 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_eefcb341ab8d4823a95c5bce47395083", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:24:25.841196 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:24:25.841196 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:24:25.841196 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:24:25.841196 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:24:25.841196 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:24:25.841196 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:24:25.841196 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: ed4711b7691643109007e173fee1c405 Aug 28 10:24:25.841196 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:24:25.841196 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Aug 28 10:24:25.841196 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {"volumeAttachment": {"volumeId": "0dbcf961-730b-41c3-b4cb-cf1b128e8205"}} Aug 28 10:24:25.841196 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: > Aug 28 10:24:25.842120 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Invalid volume: volume 0dbcf961-730b-41c3-b4cb-cf1b128e8205 is already attached to instances: b18b9c06-5718-489a-ab12-86a757322346 Aug 28 10:24:25.842120 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'server_id': 'b18b9c06-5718-489a-ab12-86a757322346', 'body': {'volumeAttachment': {'volumeId': '0dbcf961-730b-41c3-b4cb-cf1b128e8205'}}} Aug 28 10:24:25.842120 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:24:25.842120 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:24:25.842120 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 28 10:24:25.842120 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 28 10:24:25.842120 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 28 10:24:25.842120 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 28 10:24:25.842120 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 28 10:24:25.842120 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 28 10:24:25.842120 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 28 10:24:25.842120 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 28 10:24:25.842120 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 28 10:24:25.842120 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 28 10:24:25.842120 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0dbcf961-730b-41c3-b4cb-cf1b128e8205 is already attached to instances: b18b9c06-5718-489a-ab12-86a757322346 Aug 28 10:24:25.842120 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:24:25.842120 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:24:25.842120 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:24:25.842120 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:24:25.843502 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:24:25.843502 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:24:25.843502 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:24:25.843502 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:24:25.843502 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:24:25.843502 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:24:25.843502 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 28 10:24:25.843502 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 28 10:24:25.843502 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 28 10:24:25.843502 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 28 10:24:25.843502 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 28 10:24:25.843502 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 28 10:24:25.843502 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 28 10:24:25.843502 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 28 10:24:25.843502 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0dbcf961-730b-41c3-b4cb-cf1b128e8205 is already attached to instances: b18b9c06-5718-489a-ab12-86a757322346 Aug 28 10:24:25.843502 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:24:25.843502 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:24:25.843502 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:24:25.843502 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:24:25.843502 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:24:25.844994 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:24:25.844994 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:24:25.844994 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:24:25.844994 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0dbcf961-730b-41c3-b4cb-cf1b128e8205 is already attached to instances: b18b9c06-5718-489a-ab12-86a757322346 Aug 28 10:24:25.844994 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:24:25.844994 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0bae1b34-c06f-47fc-a329-669f28500812 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Returning 400 to user: Invalid volume: volume 0dbcf961-730b-41c3-b4cb-cf1b128e8205 is already attached to instances: b18b9c06-5718-489a-ab12-86a757322346 {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:24:25.844994 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0bae1b34-c06f-47fc-a329-669f28500812 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "POST /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106451 Aug 28 10:24:25.844994 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 417/818] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Aug 28 10:24:25 2022] POST /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 28 10:24:25.916863 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-a8351640-5cdc-431f-9887-d351b10ebf05 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:25.917561 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-a8351640-5cdc-431f-9887-d351b10ebf05 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:25.924812 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a8351640-5cdc-431f-9887-d351b10ebf05 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:25.925468 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a8351640-5cdc-431f-9887-d351b10ebf05 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:25.926073 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a8351640-5cdc-431f-9887-d351b10ebf05 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:25.927181 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a8351640-5cdc-431f-9887-d351b10ebf05 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:25.927766 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a8351640-5cdc-431f-9887-d351b10ebf05 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:25.928339 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a8351640-5cdc-431f-9887-d351b10ebf05 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:25.947188 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:24:26.025631 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.objects.instance [None req-a8351640-5cdc-431f-9887-d351b10ebf05 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lazy-loading 'services' on Instance uuid b18b9c06-5718-489a-ab12-86a757322346 {{(pid=120664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:24:26.112649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-a8351640-5cdc-431f-9887-d351b10ebf05 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346/os-volume_attachments/0dbcf961-730b-41c3-b4cb-cf1b128e8205" status: 202 len: 0 microversion: 2.1 time: 0.202859 Aug 28 10:24:26.113252 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 402/819] 10.222.0.40 () {58 vars in 1416 bytes} [Sun Aug 28 10:24:25 2022] DELETE /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346/os-volume_attachments/0dbcf961-730b-41c3-b4cb-cf1b128e8205 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:24:26.121843 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-95377839-d492-482c-9569-685d5f5f1df9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:26.124135 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-95377839-d492-482c-9569-685d5f5f1df9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:26.131823 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95377839-d492-482c-9569-685d5f5f1df9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:26.132392 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95377839-d492-482c-9569-685d5f5f1df9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:26.132845 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95377839-d492-482c-9569-685d5f5f1df9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:26.133670 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95377839-d492-482c-9569-685d5f5f1df9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:26.134202 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95377839-d492-482c-9569-685d5f5f1df9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:26.134619 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95377839-d492-482c-9569-685d5f5f1df9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:26.166181 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-95377839-d492-482c-9569-685d5f5f1df9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047714 Aug 28 10:24:26.166621 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 418/820] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Aug 28 10:24:26 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:24:26.365615 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e32033b7-baef-4f48-a839-673aec3ac7de tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:26.366296 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e32033b7-baef-4f48-a839-673aec3ac7de tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:26.372892 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e32033b7-baef-4f48-a839-673aec3ac7de tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:26.373367 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e32033b7-baef-4f48-a839-673aec3ac7de tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:26.373789 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e32033b7-baef-4f48-a839-673aec3ac7de tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:26.374471 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e32033b7-baef-4f48-a839-673aec3ac7de tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:26.374914 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e32033b7-baef-4f48-a839-673aec3ac7de tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:26.375324 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e32033b7-baef-4f48-a839-673aec3ac7de tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:26.562032 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-e32033b7-baef-4f48-a839-673aec3ac7de tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:26.570744 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-e32033b7-baef-4f48-a839-673aec3ac7de tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:26.572514 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-e32033b7-baef-4f48-a839-673aec3ac7de tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:26.573811 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-e32033b7-baef-4f48-a839-673aec3ac7de tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1722 microversion: 2.20 time: 0.212536 Aug 28 10:24:26.574384 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 403/821] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:26 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:26.744041 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3716e4f9-40e2-4b6b-b309-202c6cc9fd3a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:26.744638 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3716e4f9-40e2-4b6b-b309-202c6cc9fd3a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:26.751622 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3716e4f9-40e2-4b6b-b309-202c6cc9fd3a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:26.752099 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3716e4f9-40e2-4b6b-b309-202c6cc9fd3a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:26.752539 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3716e4f9-40e2-4b6b-b309-202c6cc9fd3a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:26.753251 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3716e4f9-40e2-4b6b-b309-202c6cc9fd3a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:26.753700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3716e4f9-40e2-4b6b-b309-202c6cc9fd3a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:26.754117 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3716e4f9-40e2-4b6b-b309-202c6cc9fd3a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:26.885077 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3716e4f9-40e2-4b6b-b309-202c6cc9fd3a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:26.893065 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3716e4f9-40e2-4b6b-b309-202c6cc9fd3a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1361 microversion: 2.1 time: 0.154723 Aug 28 10:24:26.893839 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 419/822] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:26 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:27.179756 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-7813ae4f-10d5-4694-b899-1793ed028fbc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:27.182523 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-7813ae4f-10d5-4694-b899-1793ed028fbc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:27.189216 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7813ae4f-10d5-4694-b899-1793ed028fbc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:27.189701 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7813ae4f-10d5-4694-b899-1793ed028fbc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:27.190166 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7813ae4f-10d5-4694-b899-1793ed028fbc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:27.190795 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7813ae4f-10d5-4694-b899-1793ed028fbc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:27.191232 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7813ae4f-10d5-4694-b899-1793ed028fbc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:27.191641 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7813ae4f-10d5-4694-b899-1793ed028fbc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:27.222834 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-7813ae4f-10d5-4694-b899-1793ed028fbc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046998 Aug 28 10:24:27.223701 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 404/823] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Aug 28 10:24:27 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 28 10:24:27.288339 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-54d37087-fc9b-4da1-8807-8413bff0dfe6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:27.288864 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-54d37087-fc9b-4da1-8807-8413bff0dfe6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:27.295388 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54d37087-fc9b-4da1-8807-8413bff0dfe6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:27.295864 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54d37087-fc9b-4da1-8807-8413bff0dfe6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:27.296364 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54d37087-fc9b-4da1-8807-8413bff0dfe6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:27.297264 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54d37087-fc9b-4da1-8807-8413bff0dfe6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:27.297704 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54d37087-fc9b-4da1-8807-8413bff0dfe6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:27.298115 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54d37087-fc9b-4da1-8807-8413bff0dfe6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:27.323002 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-54d37087-fc9b-4da1-8807-8413bff0dfe6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 28 10:24:27.412073 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-54d37087-fc9b-4da1-8807-8413bff0dfe6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 204 len: 0 microversion: 2.1 time: 0.126520 Aug 28 10:24:27.413350 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 420/824] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:24:27 2022] DELETE /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 28 10:24:27.427603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-48dc36f7-3d1e-42dc-858c-bee27d9aa90e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:27.428490 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-48dc36f7-3d1e-42dc-858c-bee27d9aa90e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:27.435636 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-48dc36f7-3d1e-42dc-858c-bee27d9aa90e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:27.436131 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-48dc36f7-3d1e-42dc-858c-bee27d9aa90e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:27.436563 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-48dc36f7-3d1e-42dc-858c-bee27d9aa90e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:27.437245 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-48dc36f7-3d1e-42dc-858c-bee27d9aa90e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:27.437689 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-48dc36f7-3d1e-42dc-858c-bee27d9aa90e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:27.438108 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-48dc36f7-3d1e-42dc-858c-bee27d9aa90e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:27.576014 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-48dc36f7-3d1e-42dc-858c-bee27d9aa90e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:27.584307 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-48dc36f7-3d1e-42dc-858c-bee27d9aa90e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 200 len: 1683 microversion: 2.1 time: 0.162659 Aug 28 10:24:27.585203 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 405/825] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:27 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:27.597334 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f3a9a92d-1b7c-4bb7-bfb1-3613509aa64e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:27.598019 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f3a9a92d-1b7c-4bb7-bfb1-3613509aa64e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:27.604212 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3a9a92d-1b7c-4bb7-bfb1-3613509aa64e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:27.604746 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3a9a92d-1b7c-4bb7-bfb1-3613509aa64e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:27.605251 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3a9a92d-1b7c-4bb7-bfb1-3613509aa64e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:27.605819 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3a9a92d-1b7c-4bb7-bfb1-3613509aa64e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:27.606257 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3a9a92d-1b7c-4bb7-bfb1-3613509aa64e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:27.606696 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3a9a92d-1b7c-4bb7-bfb1-3613509aa64e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:27.738154 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f3a9a92d-1b7c-4bb7-bfb1-3613509aa64e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:27.746668 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f3a9a92d-1b7c-4bb7-bfb1-3613509aa64e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:27.748081 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f3a9a92d-1b7c-4bb7-bfb1-3613509aa64e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:27.749287 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f3a9a92d-1b7c-4bb7-bfb1-3613509aa64e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1722 microversion: 2.20 time: 0.156308 Aug 28 10:24:27.750095 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 421/826] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:27 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:27.914381 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-855a51bf-a242-4218-8a5b-6c2074c51f6f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:27.914969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-855a51bf-a242-4218-8a5b-6c2074c51f6f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:27.921389 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-855a51bf-a242-4218-8a5b-6c2074c51f6f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:27.921863 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-855a51bf-a242-4218-8a5b-6c2074c51f6f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:27.922469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-855a51bf-a242-4218-8a5b-6c2074c51f6f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:27.923152 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-855a51bf-a242-4218-8a5b-6c2074c51f6f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:27.923746 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-855a51bf-a242-4218-8a5b-6c2074c51f6f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:27.924355 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-855a51bf-a242-4218-8a5b-6c2074c51f6f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:28.063013 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-855a51bf-a242-4218-8a5b-6c2074c51f6f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:28.070973 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-855a51bf-a242-4218-8a5b-6c2074c51f6f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1361 microversion: 2.1 time: 0.160637 Aug 28 10:24:28.071555 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 406/827] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:27 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:28.541525 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-cca9407c-729b-4267-ae5b-84189539dcaf req-58aaa0f0-1eda-4649-a838-bd85979fb6fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b283b4eb-2390-47c6-8b41-372447998650", "name": "network-vif-plugged", "status": "completed", "tag": "7ed5d47b-49d1-428d-a635-8a4afe3a65e4"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:24:28.552059 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-cca9407c-729b-4267-ae5b-84189539dcaf req-58aaa0f0-1eda-4649-a838-bd85979fb6fa service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:28.552557 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-cca9407c-729b-4267-ae5b-84189539dcaf req-58aaa0f0-1eda-4649-a838-bd85979fb6fa service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:28.552983 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-cca9407c-729b-4267-ae5b-84189539dcaf req-58aaa0f0-1eda-4649-a838-bd85979fb6fa service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:28.564276 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-cca9407c-729b-4267-ae5b-84189539dcaf req-58aaa0f0-1eda-4649-a838-bd85979fb6fa service nova] Creating event network-vif-plugged:7ed5d47b-49d1-428d-a635-8a4afe3a65e4 for instance b283b4eb-2390-47c6-8b41-372447998650 on hv-cinder-85200 Aug 28 10:24:28.569076 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-cca9407c-729b-4267-ae5b-84189539dcaf req-58aaa0f0-1eda-4649-a838-bd85979fb6fa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031406 Aug 28 10:24:28.569681 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 422/828] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:24:28.606188 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-0fe6c826-709b-4a4e-b98e-70a656ca7b1f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:28.606991 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-0fe6c826-709b-4a4e-b98e-70a656ca7b1f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:28.613669 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0fe6c826-709b-4a4e-b98e-70a656ca7b1f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:28.614148 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0fe6c826-709b-4a4e-b98e-70a656ca7b1f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:28.614574 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0fe6c826-709b-4a4e-b98e-70a656ca7b1f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:28.615266 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0fe6c826-709b-4a4e-b98e-70a656ca7b1f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:28.615757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0fe6c826-709b-4a4e-b98e-70a656ca7b1f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:28.616116 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0fe6c826-709b-4a4e-b98e-70a656ca7b1f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:28.749496 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-0fe6c826-709b-4a4e-b98e-70a656ca7b1f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:28.757712 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-0fe6c826-709b-4a4e-b98e-70a656ca7b1f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 200 len: 1683 microversion: 2.1 time: 0.155551 Aug 28 10:24:28.758288 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 407/829] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:28 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:28.773980 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8160f0e7-4280-4ef4-a2be-fb4737f102a3 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:28.774684 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8160f0e7-4280-4ef4-a2be-fb4737f102a3 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:28.781237 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8160f0e7-4280-4ef4-a2be-fb4737f102a3 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:28.781696 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8160f0e7-4280-4ef4-a2be-fb4737f102a3 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:28.782150 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8160f0e7-4280-4ef4-a2be-fb4737f102a3 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:28.782850 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8160f0e7-4280-4ef4-a2be-fb4737f102a3 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:28.783288 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8160f0e7-4280-4ef4-a2be-fb4737f102a3 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:28.783707 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8160f0e7-4280-4ef4-a2be-fb4737f102a3 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:28.916964 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8160f0e7-4280-4ef4-a2be-fb4737f102a3 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:28.925537 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8160f0e7-4280-4ef4-a2be-fb4737f102a3 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:28.927012 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8160f0e7-4280-4ef4-a2be-fb4737f102a3 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:28.928173 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8160f0e7-4280-4ef4-a2be-fb4737f102a3 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1722 microversion: 2.20 time: 0.158538 Aug 28 10:24:28.928741 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 423/830] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:28 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:29.092388 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-7f6ed826-6eee-49dd-9438-83b183b7b4b8 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:29.093001 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-7f6ed826-6eee-49dd-9438-83b183b7b4b8 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:29.099225 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7f6ed826-6eee-49dd-9438-83b183b7b4b8 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:29.099694 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7f6ed826-6eee-49dd-9438-83b183b7b4b8 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:29.100636 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7f6ed826-6eee-49dd-9438-83b183b7b4b8 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:29.101326 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7f6ed826-6eee-49dd-9438-83b183b7b4b8 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:29.101749 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7f6ed826-6eee-49dd-9438-83b183b7b4b8 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:29.102342 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7f6ed826-6eee-49dd-9438-83b183b7b4b8 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:29.249962 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7f6ed826-6eee-49dd-9438-83b183b7b4b8 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:29.258162 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-7f6ed826-6eee-49dd-9438-83b183b7b4b8 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1361 microversion: 2.1 time: 0.169566 Aug 28 10:24:29.258752 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 408/831] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:29 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:29.782705 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0238047c-8da4-4aab-acdc-7e85db8dab20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:29.783550 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0238047c-8da4-4aab-acdc-7e85db8dab20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:29.794771 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0238047c-8da4-4aab-acdc-7e85db8dab20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:29.795556 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0238047c-8da4-4aab-acdc-7e85db8dab20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:29.796263 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0238047c-8da4-4aab-acdc-7e85db8dab20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:29.797451 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0238047c-8da4-4aab-acdc-7e85db8dab20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:29.798190 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0238047c-8da4-4aab-acdc-7e85db8dab20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:29.798883 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0238047c-8da4-4aab-acdc-7e85db8dab20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:29.931255 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0238047c-8da4-4aab-acdc-7e85db8dab20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:29.939090 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0238047c-8da4-4aab-acdc-7e85db8dab20 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 200 len: 1683 microversion: 2.1 time: 0.163170 Aug 28 10:24:29.939692 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 424/832] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:29 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:29.951643 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4753548a-4828-4eca-8fde-0925d1b28cd1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:29.952261 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4753548a-4828-4eca-8fde-0925d1b28cd1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:29.958855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4753548a-4828-4eca-8fde-0925d1b28cd1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:29.959332 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4753548a-4828-4eca-8fde-0925d1b28cd1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:29.959754 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4753548a-4828-4eca-8fde-0925d1b28cd1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:29.960432 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4753548a-4828-4eca-8fde-0925d1b28cd1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:29.960904 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4753548a-4828-4eca-8fde-0925d1b28cd1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:29.961321 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4753548a-4828-4eca-8fde-0925d1b28cd1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:30.089666 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4753548a-4828-4eca-8fde-0925d1b28cd1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:30.098361 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4753548a-4828-4eca-8fde-0925d1b28cd1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:30.099791 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4753548a-4828-4eca-8fde-0925d1b28cd1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:30.100973 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4753548a-4828-4eca-8fde-0925d1b28cd1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1722 microversion: 2.20 time: 0.153589 Aug 28 10:24:30.101533 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 409/833] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:29 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:30.279845 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1b8a36f7-ee3d-46ac-bca8-8b38184e8278 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:30.280584 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1b8a36f7-ee3d-46ac-bca8-8b38184e8278 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:30.288800 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1b8a36f7-ee3d-46ac-bca8-8b38184e8278 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:30.289315 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1b8a36f7-ee3d-46ac-bca8-8b38184e8278 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:30.289845 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1b8a36f7-ee3d-46ac-bca8-8b38184e8278 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:30.290731 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1b8a36f7-ee3d-46ac-bca8-8b38184e8278 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:30.291148 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1b8a36f7-ee3d-46ac-bca8-8b38184e8278 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:30.291586 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1b8a36f7-ee3d-46ac-bca8-8b38184e8278 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:30.422508 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1b8a36f7-ee3d-46ac-bca8-8b38184e8278 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:30.431854 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1b8a36f7-ee3d-46ac-bca8-8b38184e8278 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1361 microversion: 2.1 time: 0.155326 Aug 28 10:24:30.431854 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 425/834] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:30 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:30.964462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-adcb8b2e-71ff-4f6e-810f-f562b43d5551 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:30.965509 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-adcb8b2e-71ff-4f6e-810f-f562b43d5551 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:30.976609 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-adcb8b2e-71ff-4f6e-810f-f562b43d5551 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:30.977433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-adcb8b2e-71ff-4f6e-810f-f562b43d5551 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:30.978087 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-adcb8b2e-71ff-4f6e-810f-f562b43d5551 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:30.978774 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-adcb8b2e-71ff-4f6e-810f-f562b43d5551 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:30.979256 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-adcb8b2e-71ff-4f6e-810f-f562b43d5551 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:30.979672 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-adcb8b2e-71ff-4f6e-810f-f562b43d5551 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:31.119788 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-adcb8b2e-71ff-4f6e-810f-f562b43d5551 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:31.123797 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-32bedeb9-308b-4f0f-a7e1-b9ddcd413f16 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:31.124383 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-32bedeb9-308b-4f0f-a7e1-b9ddcd413f16 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:31.127670 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-adcb8b2e-71ff-4f6e-810f-f562b43d5551 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 200 len: 1683 microversion: 2.1 time: 0.169717 Aug 28 10:24:31.128243 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 410/835] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:30 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:31.131110 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-32bedeb9-308b-4f0f-a7e1-b9ddcd413f16 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:31.131659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-32bedeb9-308b-4f0f-a7e1-b9ddcd413f16 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:31.132156 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-32bedeb9-308b-4f0f-a7e1-b9ddcd413f16 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:31.132913 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-32bedeb9-308b-4f0f-a7e1-b9ddcd413f16 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:31.133362 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-32bedeb9-308b-4f0f-a7e1-b9ddcd413f16 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:31.133780 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-32bedeb9-308b-4f0f-a7e1-b9ddcd413f16 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:31.266430 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-32bedeb9-308b-4f0f-a7e1-b9ddcd413f16 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:31.274790 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-32bedeb9-308b-4f0f-a7e1-b9ddcd413f16 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:31.276220 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-32bedeb9-308b-4f0f-a7e1-b9ddcd413f16 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:31.277404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-32bedeb9-308b-4f0f-a7e1-b9ddcd413f16 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1722 microversion: 2.20 time: 0.157531 Aug 28 10:24:31.277978 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 426/836] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:31 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:31.455396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-cf370811-b786-407c-9a27-02014b4f72ee tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:31.456423 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-cf370811-b786-407c-9a27-02014b4f72ee tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:31.465655 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cf370811-b786-407c-9a27-02014b4f72ee tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:31.466018 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cf370811-b786-407c-9a27-02014b4f72ee tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:31.466447 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cf370811-b786-407c-9a27-02014b4f72ee tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:31.467135 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cf370811-b786-407c-9a27-02014b4f72ee tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:31.467580 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cf370811-b786-407c-9a27-02014b4f72ee tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:31.467997 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cf370811-b786-407c-9a27-02014b4f72ee tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:31.600085 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-cf370811-b786-407c-9a27-02014b4f72ee tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:31.608380 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-cf370811-b786-407c-9a27-02014b4f72ee tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1361 microversion: 2.1 time: 0.159560 Aug 28 10:24:31.609019 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 411/837] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:31 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:32.152989 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ee07a002-9ba0-418f-a4d1-bf8e26b00e91 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:32.154034 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ee07a002-9ba0-418f-a4d1-bf8e26b00e91 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:32.165211 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee07a002-9ba0-418f-a4d1-bf8e26b00e91 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:32.166004 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee07a002-9ba0-418f-a4d1-bf8e26b00e91 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:32.166756 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee07a002-9ba0-418f-a4d1-bf8e26b00e91 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:32.167895 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee07a002-9ba0-418f-a4d1-bf8e26b00e91 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:32.169054 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee07a002-9ba0-418f-a4d1-bf8e26b00e91 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:32.169749 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee07a002-9ba0-418f-a4d1-bf8e26b00e91 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:32.300011 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-ed3faf37-d5ee-4951-aa2f-baf555269ded tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:32.300617 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-ed3faf37-d5ee-4951-aa2f-baf555269ded tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:32.307680 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ed3faf37-d5ee-4951-aa2f-baf555269ded tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:32.308166 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ed3faf37-d5ee-4951-aa2f-baf555269ded tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:32.308623 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ed3faf37-d5ee-4951-aa2f-baf555269ded tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:32.309382 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ed3faf37-d5ee-4951-aa2f-baf555269ded tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:32.310010 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ed3faf37-d5ee-4951-aa2f-baf555269ded tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:32.310219 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ed3faf37-d5ee-4951-aa2f-baf555269ded tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:32.312625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ee07a002-9ba0-418f-a4d1-bf8e26b00e91 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:32.321265 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ee07a002-9ba0-418f-a4d1-bf8e26b00e91 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 200 len: 1683 microversion: 2.1 time: 0.174941 Aug 28 10:24:32.334833 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 427/838] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:32 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 1683 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:32.452739 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-ed3faf37-d5ee-4951-aa2f-baf555269ded tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:32.464987 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-ed3faf37-d5ee-4951-aa2f-baf555269ded tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:32.467282 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-ed3faf37-d5ee-4951-aa2f-baf555269ded tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:32.469022 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-ed3faf37-d5ee-4951-aa2f-baf555269ded tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1722 microversion: 2.20 time: 0.172999 Aug 28 10:24:32.469865 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 412/839] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:32 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:32.633866 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4b79020d-6a71-40c7-b6bc-a8e5d4d2907f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:32.634811 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4b79020d-6a71-40c7-b6bc-a8e5d4d2907f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:32.645143 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4b79020d-6a71-40c7-b6bc-a8e5d4d2907f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:32.645766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4b79020d-6a71-40c7-b6bc-a8e5d4d2907f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:32.646472 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4b79020d-6a71-40c7-b6bc-a8e5d4d2907f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:32.647601 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4b79020d-6a71-40c7-b6bc-a8e5d4d2907f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:32.648340 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4b79020d-6a71-40c7-b6bc-a8e5d4d2907f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:32.649090 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4b79020d-6a71-40c7-b6bc-a8e5d4d2907f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:32.781534 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4b79020d-6a71-40c7-b6bc-a8e5d4d2907f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:32.789479 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4b79020d-6a71-40c7-b6bc-a8e5d4d2907f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1361 microversion: 2.1 time: 0.162266 Aug 28 10:24:32.790104 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 428/840] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:32 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:33.346774 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-b3abe4db-fd5c-44af-a141-2b9d7a7926bd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:33.347982 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-b3abe4db-fd5c-44af-a141-2b9d7a7926bd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:33.356718 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b3abe4db-fd5c-44af-a141-2b9d7a7926bd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:33.357203 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b3abe4db-fd5c-44af-a141-2b9d7a7926bd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:33.357633 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b3abe4db-fd5c-44af-a141-2b9d7a7926bd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:33.358462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b3abe4db-fd5c-44af-a141-2b9d7a7926bd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:33.358912 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b3abe4db-fd5c-44af-a141-2b9d7a7926bd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:33.359334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b3abe4db-fd5c-44af-a141-2b9d7a7926bd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:33.495591 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2853f17f-7fd0-4385-aba6-98e9e9a95a61 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:33.496278 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2853f17f-7fd0-4385-aba6-98e9e9a95a61 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:33.503113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2853f17f-7fd0-4385-aba6-98e9e9a95a61 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:33.503926 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2853f17f-7fd0-4385-aba6-98e9e9a95a61 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:33.504356 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2853f17f-7fd0-4385-aba6-98e9e9a95a61 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:33.505079 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2853f17f-7fd0-4385-aba6-98e9e9a95a61 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:33.505524 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2853f17f-7fd0-4385-aba6-98e9e9a95a61 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:33.505927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2853f17f-7fd0-4385-aba6-98e9e9a95a61 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:33.509460 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-b3abe4db-fd5c-44af-a141-2b9d7a7926bd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:33.517567 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-b3abe4db-fd5c-44af-a141-2b9d7a7926bd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 200 len: 1683 microversion: 2.1 time: 0.177459 Aug 28 10:24:33.518140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 413/841] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:33 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:33.639617 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2853f17f-7fd0-4385-aba6-98e9e9a95a61 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:33.650734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2853f17f-7fd0-4385-aba6-98e9e9a95a61 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:33.652152 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2853f17f-7fd0-4385-aba6-98e9e9a95a61 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:33.653326 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2853f17f-7fd0-4385-aba6-98e9e9a95a61 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1722 microversion: 2.20 time: 0.161922 Aug 28 10:24:33.653917 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 429/842] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:33 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:33.814461 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-5b6a61e8-2bc2-4d69-873b-0cf3de629f8c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:33.815449 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-5b6a61e8-2bc2-4d69-873b-0cf3de629f8c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:33.818558 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:24:33.825164 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5b6a61e8-2bc2-4d69-873b-0cf3de629f8c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:33.825637 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5b6a61e8-2bc2-4d69-873b-0cf3de629f8c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:33.826057 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5b6a61e8-2bc2-4d69-873b-0cf3de629f8c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:33.826730 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5b6a61e8-2bc2-4d69-873b-0cf3de629f8c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:33.827172 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5b6a61e8-2bc2-4d69-873b-0cf3de629f8c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:33.827583 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5b6a61e8-2bc2-4d69-873b-0cf3de629f8c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:33.958037 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-5b6a61e8-2bc2-4d69-873b-0cf3de629f8c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:33.966339 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-5b6a61e8-2bc2-4d69-873b-0cf3de629f8c tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1361 microversion: 2.1 time: 0.158380 Aug 28 10:24:33.966906 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 414/843] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:33 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:34.539549 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a69a600c-5d4c-4946-84b5-dade770605b1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:34.540351 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a69a600c-5d4c-4946-84b5-dade770605b1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:34.544254 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:24:34.548064 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a69a600c-5d4c-4946-84b5-dade770605b1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:34.548767 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a69a600c-5d4c-4946-84b5-dade770605b1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:34.549198 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a69a600c-5d4c-4946-84b5-dade770605b1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:34.549909 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a69a600c-5d4c-4946-84b5-dade770605b1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:34.550340 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a69a600c-5d4c-4946-84b5-dade770605b1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:34.550753 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a69a600c-5d4c-4946-84b5-dade770605b1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:34.678168 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-581c6a52-74a4-463c-b578-6411310fb989 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:34.679461 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-581c6a52-74a4-463c-b578-6411310fb989 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:34.687229 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-581c6a52-74a4-463c-b578-6411310fb989 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:34.688163 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-581c6a52-74a4-463c-b578-6411310fb989 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:34.689051 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-581c6a52-74a4-463c-b578-6411310fb989 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:34.690136 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-581c6a52-74a4-463c-b578-6411310fb989 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:34.690950 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-581c6a52-74a4-463c-b578-6411310fb989 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:34.691577 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-581c6a52-74a4-463c-b578-6411310fb989 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:34.705564 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a69a600c-5d4c-4946-84b5-dade770605b1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:34.721875 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a69a600c-5d4c-4946-84b5-dade770605b1 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 200 len: 1683 microversion: 2.1 time: 0.182223 Aug 28 10:24:34.733583 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 430/844] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:34 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 1683 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:34.869511 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-581c6a52-74a4-463c-b578-6411310fb989 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:34.877826 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-581c6a52-74a4-463c-b578-6411310fb989 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:34.879258 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-581c6a52-74a4-463c-b578-6411310fb989 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:34.880493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-581c6a52-74a4-463c-b578-6411310fb989 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1722 microversion: 2.20 time: 0.207080 Aug 28 10:24:34.881317 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 415/845] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:34 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:34.991460 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bdbc8434-2910-4cae-b80b-267e54d9738d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:34.992067 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bdbc8434-2910-4cae-b80b-267e54d9738d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:34.998219 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bdbc8434-2910-4cae-b80b-267e54d9738d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:34.998687 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bdbc8434-2910-4cae-b80b-267e54d9738d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:34.999116 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bdbc8434-2910-4cae-b80b-267e54d9738d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:34.999814 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bdbc8434-2910-4cae-b80b-267e54d9738d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:35.000259 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bdbc8434-2910-4cae-b80b-267e54d9738d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:35.000725 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bdbc8434-2910-4cae-b80b-267e54d9738d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:35.018787 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:24:35.076339 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-1d4718ca-875b-422f-b020-fd8fb9b1ac4f req-dfc89ec6-9cdf-472c-aa3e-b473040ba14a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b18b9c06-5718-489a-ab12-86a757322346", "name": "network-vif-deleted", "tag": "776d23e6-7d32-4806-bb5f-8219e58b4651"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:24:35.091257 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-1d4718ca-875b-422f-b020-fd8fb9b1ac4f req-dfc89ec6-9cdf-472c-aa3e-b473040ba14a service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:35.092368 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-1d4718ca-875b-422f-b020-fd8fb9b1ac4f req-dfc89ec6-9cdf-472c-aa3e-b473040ba14a service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:35.093218 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-1d4718ca-875b-422f-b020-fd8fb9b1ac4f req-dfc89ec6-9cdf-472c-aa3e-b473040ba14a service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:35.106627 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-1d4718ca-875b-422f-b020-fd8fb9b1ac4f req-dfc89ec6-9cdf-472c-aa3e-b473040ba14a service nova] Creating event network-vif-deleted:776d23e6-7d32-4806-bb5f-8219e58b4651 for instance b18b9c06-5718-489a-ab12-86a757322346 on hv-cinder-85200 Aug 28 10:24:35.112285 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-1d4718ca-875b-422f-b020-fd8fb9b1ac4f req-dfc89ec6-9cdf-472c-aa3e-b473040ba14a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040487 Aug 28 10:24:35.114504 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 416/846] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:24:35.163647 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bdbc8434-2910-4cae-b80b-267e54d9738d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:35.175821 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bdbc8434-2910-4cae-b80b-267e54d9738d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1361 microversion: 2.1 time: 0.188311 Aug 28 10:24:35.177112 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 431/847] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:34 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:35.742367 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-24d90d5b-2ea3-4870-ace8-7e138400499f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:35.743031 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-24d90d5b-2ea3-4870-ace8-7e138400499f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:35.753291 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24d90d5b-2ea3-4870-ace8-7e138400499f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:35.753806 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24d90d5b-2ea3-4870-ace8-7e138400499f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:35.754228 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24d90d5b-2ea3-4870-ace8-7e138400499f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:35.755503 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24d90d5b-2ea3-4870-ace8-7e138400499f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:35.755695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24d90d5b-2ea3-4870-ace8-7e138400499f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:35.764480 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24d90d5b-2ea3-4870-ace8-7e138400499f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:35.813850 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24d90d5b-2ea3-4870-ace8-7e138400499f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:35.814376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24d90d5b-2ea3-4870-ace8-7e138400499f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:35.814829 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24d90d5b-2ea3-4870-ace8-7e138400499f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:35.815167 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.objects.instance [None req-24d90d5b-2ea3-4870-ace8-7e138400499f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lazy-loading 'fault' on Instance uuid b18b9c06-5718-489a-ab12-86a757322346 {{(pid=120664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:24:35.879565 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-24d90d5b-2ea3-4870-ace8-7e138400499f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:35.887777 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-24d90d5b-2ea3-4870-ace8-7e138400499f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 200 len: 1332 microversion: 2.1 time: 0.151053 Aug 28 10:24:35.888386 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 417/848] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:35 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 1332 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:35.905389 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-63b95614-fe7f-4334-9c2e-c9d96cb5e569 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:35.906139 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-63b95614-fe7f-4334-9c2e-c9d96cb5e569 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:35.914319 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-63b95614-fe7f-4334-9c2e-c9d96cb5e569 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:35.914921 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-63b95614-fe7f-4334-9c2e-c9d96cb5e569 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:35.915476 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-63b95614-fe7f-4334-9c2e-c9d96cb5e569 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:35.916271 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-63b95614-fe7f-4334-9c2e-c9d96cb5e569 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:35.919638 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-63b95614-fe7f-4334-9c2e-c9d96cb5e569 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:35.920078 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-63b95614-fe7f-4334-9c2e-c9d96cb5e569 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:36.059538 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-63b95614-fe7f-4334-9c2e-c9d96cb5e569 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:36.068991 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-63b95614-fe7f-4334-9c2e-c9d96cb5e569 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:36.070684 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-63b95614-fe7f-4334-9c2e-c9d96cb5e569 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:36.071897 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-63b95614-fe7f-4334-9c2e-c9d96cb5e569 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1722 microversion: 2.20 time: 0.170462 Aug 28 10:24:36.088347 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 432/849] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:35 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:36.199024 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-ebc12d72-b5f7-45dd-be62-fd064acf495d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:36.200051 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-ebc12d72-b5f7-45dd-be62-fd064acf495d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:36.206398 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ebc12d72-b5f7-45dd-be62-fd064acf495d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:36.206959 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ebc12d72-b5f7-45dd-be62-fd064acf495d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:36.207455 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ebc12d72-b5f7-45dd-be62-fd064acf495d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:36.208209 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ebc12d72-b5f7-45dd-be62-fd064acf495d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:36.208779 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ebc12d72-b5f7-45dd-be62-fd064acf495d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:36.209264 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ebc12d72-b5f7-45dd-be62-fd064acf495d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:36.348443 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-ebc12d72-b5f7-45dd-be62-fd064acf495d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:36.352082 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:24:36.356841 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-ebc12d72-b5f7-45dd-be62-fd064acf495d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1547 microversion: 2.1 time: 0.162052 Aug 28 10:24:36.357525 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 418/850] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:36 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:36.378288 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-808ffc0a-720f-40c9-9dd6-f4917a9fdc2f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:36.378777 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-808ffc0a-720f-40c9-9dd6-f4917a9fdc2f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:36.385003 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-808ffc0a-720f-40c9-9dd6-f4917a9fdc2f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:36.385493 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-808ffc0a-720f-40c9-9dd6-f4917a9fdc2f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:36.385926 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-808ffc0a-720f-40c9-9dd6-f4917a9fdc2f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:36.386618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-808ffc0a-720f-40c9-9dd6-f4917a9fdc2f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:36.387069 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-808ffc0a-720f-40c9-9dd6-f4917a9fdc2f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:36.387488 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-808ffc0a-720f-40c9-9dd6-f4917a9fdc2f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:36.467197 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-808ffc0a-720f-40c9-9dd6-f4917a9fdc2f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092904 Aug 28 10:24:36.467843 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 433/851] 10.222.0.40 () {58 vars in 1275 bytes} [Sun Aug 28 10:24:36 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:24:36.910603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-7c0b1fd8-5930-46e5-969d-853194e4f2ee tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:36.911216 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-7c0b1fd8-5930-46e5-969d-853194e4f2ee tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:36.918998 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7c0b1fd8-5930-46e5-969d-853194e4f2ee tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:36.919427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7c0b1fd8-5930-46e5-969d-853194e4f2ee tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:36.919853 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7c0b1fd8-5930-46e5-969d-853194e4f2ee tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:36.920550 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7c0b1fd8-5930-46e5-969d-853194e4f2ee tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:36.921008 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7c0b1fd8-5930-46e5-969d-853194e4f2ee tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:36.921406 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7c0b1fd8-5930-46e5-969d-853194e4f2ee tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:36.935676 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-7c0b1fd8-5930-46e5-969d-853194e4f2ee tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] HTTP exception thrown: Instance b18b9c06-5718-489a-ab12-86a757322346 could not be found. Aug 28 10:24:36.937365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-7c0b1fd8-5930-46e5-969d-853194e4f2ee tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Request method failure captured: Aug 28 10:24:36.937365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 HTTP/1.1 Aug 28 10:24:36.937365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:24:36.937365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:24:36.937365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:24:36.937365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:24:36.937365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:24:36.937365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:24:36.937365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:24:36.937365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:24:36.937365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0BavBPfn9Wuv1kO4_4p6KYI6akLuIPAA1OxoMOfBpiurh2AuIBrDxo6hNz9wgslLyVrLvU5C-5Daa9wSWxwGejTKWsNtPvyULf4-HsU7LK2myKRcFzE4k1R7_TjPnuTN-hG4pARjml16ldcyWGxfFf1ULa1aMpcmJVMbJUsqOVrYCU Aug 28 10:24:36.937365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:24:36.937365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:24:36.937365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:24:36.937365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:24:36.937365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:24:36.937365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:24:36.937365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:24:36.937365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:24:36.937365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:24:36.937365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:24:36.938786 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_eefcb341ab8d4823a95c5bce47395083", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:24:36.938786 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:24:36.938786 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:24:36.938786 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:24:36.938786 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:24:36.938786 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:24:36.938786 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:24:36.938786 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: ed4711b7691643109007e173fee1c405 Aug 28 10:24:36.938786 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:24:36.938786 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: > Aug 28 10:24:36.938786 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Instance b18b9c06-5718-489a-ab12-86a757322346 could not be found. Aug 28 10:24:36.938786 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': 'b18b9c06-5718-489a-ab12-86a757322346'} Aug 28 10:24:36.939601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:24:36.939601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:24:36.939601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:24:36.939601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:24:36.939601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:24:36.939601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:24:36.939601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:24:36.939601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:24:36.939601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:24:36.939601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:24:36.939601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b18b9c06-5718-489a-ab12-86a757322346 could not be found. Aug 28 10:24:36.939601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:24:36.939601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:24:36.939601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:24:36.939601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:24:36.939601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:24:36.939601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:24:36.939601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:24:36.939601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:24:36.939601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:24:36.940917 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:24:36.940917 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:24:36.940917 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:24:36.940917 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:24:36.940917 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:24:36.940917 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:24:36.940917 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:24:36.940917 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b18b9c06-5718-489a-ab12-86a757322346 could not be found. Aug 28 10:24:36.940917 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:24:36.940917 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:24:36.940917 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:24:36.940917 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:24:36.940917 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:24:36.940917 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:24:36.940917 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:24:36.940917 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:24:36.940917 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b18b9c06-5718-489a-ab12-86a757322346 could not be found. Aug 28 10:24:36.940917 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:24:36.942063 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-7c0b1fd8-5930-46e5-969d-853194e4f2ee tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Returning 404 to user: Instance b18b9c06-5718-489a-ab12-86a757322346 could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:24:36.942063 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-7c0b1fd8-5930-46e5-969d-853194e4f2ee tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 404 len: 111 microversion: 2.1 time: 0.032057 Aug 28 10:24:36.942063 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 419/852] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:36 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:24:36.948436 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7e0968ec-957f-4e51-b1a8-5a8c5e742ccb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '.version_select at 0x7f7a1c222d30>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:36.968916 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7e0968ec-957f-4e51-b1a8-5a8c5e742ccb tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1654926663" status: 202 len: 0 microversion: 2.1 time: 0.024761 Aug 28 10:24:36.969707 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 434/853] 10.222.0.40 () {58 vars in 1221 bytes} [Sun Aug 28 10:24:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1654926663 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:24:37.095719 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-fc9b90fd-8af9-4c99-a1a9-e410274e9602 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:37.096333 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-fc9b90fd-8af9-4c99-a1a9-e410274e9602 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:37.103777 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fc9b90fd-8af9-4c99-a1a9-e410274e9602 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:37.104261 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fc9b90fd-8af9-4c99-a1a9-e410274e9602 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:37.104935 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fc9b90fd-8af9-4c99-a1a9-e410274e9602 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:37.105855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fc9b90fd-8af9-4c99-a1a9-e410274e9602 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:37.106361 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fc9b90fd-8af9-4c99-a1a9-e410274e9602 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:37.106716 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fc9b90fd-8af9-4c99-a1a9-e410274e9602 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:37.362033 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-fc9b90fd-8af9-4c99-a1a9-e410274e9602 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:37.375969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-fc9b90fd-8af9-4c99-a1a9-e410274e9602 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:37.377541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-fc9b90fd-8af9-4c99-a1a9-e410274e9602 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:37.378959 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-fc9b90fd-8af9-4c99-a1a9-e410274e9602 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1722 microversion: 2.20 time: 0.287657 Aug 28 10:24:37.392541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 420/854] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:37 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1722 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:37.652549 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b4c88a99-689b-440c-946e-ab8b670515a7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Action: 'create', calling method: .version_select at 0x7f7a1c198b80>, body: {"keypair": {"name": "tempest-keypair-568347225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0UU+Sy2ol5D6Pg+4+1qCokkNNvzWHx242DaFqmgH70GYkXMrqOXejIgUe7cXq15LvB+fZiN4osJmKSnIiZ5x9M6czpkFth8XySn57vHEpmDPOziiyUB5VZZC7NZTA7wA=="}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:24:37.667614 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-b4c88a99-689b-440c-946e-ab8b670515a7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Getting quotas for project eefcb341ab8d4823a95c5bce47395083. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:24:37.672372 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-b4c88a99-689b-440c-946e-ab8b670515a7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Getting quotas for user ed4711b7691643109007e173fee1c405 and project eefcb341ab8d4823a95c5bce47395083. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:24:37.697321 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b4c88a99-689b-440c-946e-ab8b670515a7 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048807 Aug 28 10:24:37.703521 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 435/855] 10.222.0.40 () {60 vars in 1159 bytes} [Sun Aug 28 10:24:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:24:37.760390 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-b853e74e-65d9-451b-805b-12742d4dc89a req-44173cbe-085a-4fc7-a913-2e55aa6b909d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b283b4eb-2390-47c6-8b41-372447998650", "tag": "7ed5d47b-49d1-428d-a635-8a4afe3a65e4"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:24:37.772106 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-b853e74e-65d9-451b-805b-12742d4dc89a req-44173cbe-085a-4fc7-a913-2e55aa6b909d service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:37.772597 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-b853e74e-65d9-451b-805b-12742d4dc89a req-44173cbe-085a-4fc7-a913-2e55aa6b909d service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:37.774399 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-b853e74e-65d9-451b-805b-12742d4dc89a req-44173cbe-085a-4fc7-a913-2e55aa6b909d service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:37.794040 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-b853e74e-65d9-451b-805b-12742d4dc89a req-44173cbe-085a-4fc7-a913-2e55aa6b909d service nova] Creating event network-changed:7ed5d47b-49d1-428d-a635-8a4afe3a65e4 for instance b283b4eb-2390-47c6-8b41-372447998650 on hv-cinder-85200 Aug 28 10:24:37.800303 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-b853e74e-65d9-451b-805b-12742d4dc89a req-44173cbe-085a-4fc7-a913-2e55aa6b909d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043654 Aug 28 10:24:37.801749 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 421/856] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:24:38.408001 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6636a323-9fd8-429d-a025-dd28eca699da tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:38.408699 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6636a323-9fd8-429d-a025-dd28eca699da tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:38.420735 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6636a323-9fd8-429d-a025-dd28eca699da tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:38.421787 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6636a323-9fd8-429d-a025-dd28eca699da tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:38.422602 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6636a323-9fd8-429d-a025-dd28eca699da tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:38.423489 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6636a323-9fd8-429d-a025-dd28eca699da tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:38.424032 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6636a323-9fd8-429d-a025-dd28eca699da tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:38.424575 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6636a323-9fd8-429d-a025-dd28eca699da tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:38.609564 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6636a323-9fd8-429d-a025-dd28eca699da tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:38.620438 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6636a323-9fd8-429d-a025-dd28eca699da tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:38.622048 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6636a323-9fd8-429d-a025-dd28eca699da tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:38.623278 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6636a323-9fd8-429d-a025-dd28eca699da tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1722 microversion: 2.20 time: 0.220266 Aug 28 10:24:38.623852 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 436/857] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:38 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:39.650156 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-bea1a3dd-694a-4e88-bd4d-d95b51e36356 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:39.651365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-bea1a3dd-694a-4e88-bd4d-d95b51e36356 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:39.658742 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-bea1a3dd-694a-4e88-bd4d-d95b51e36356 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:39.659290 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-bea1a3dd-694a-4e88-bd4d-d95b51e36356 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:39.659953 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-bea1a3dd-694a-4e88-bd4d-d95b51e36356 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:39.660797 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-bea1a3dd-694a-4e88-bd4d-d95b51e36356 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:39.661575 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-bea1a3dd-694a-4e88-bd4d-d95b51e36356 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:39.661995 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-bea1a3dd-694a-4e88-bd4d-d95b51e36356 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:39.874345 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-bea1a3dd-694a-4e88-bd4d-d95b51e36356 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:39.882946 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-bea1a3dd-694a-4e88-bd4d-d95b51e36356 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:39.884408 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-bea1a3dd-694a-4e88-bd4d-d95b51e36356 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:39.885638 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-bea1a3dd-694a-4e88-bd4d-d95b51e36356 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1722 microversion: 2.20 time: 0.240457 Aug 28 10:24:39.886387 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 422/858] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:39 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:39.941126 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-996ea15a-ffc8-4b99-9844-fcdffc9eb744 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1032976841", "imageRef": "2780c39b-8bd3-4e73-9669-2b2e29474f3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68250cdd-7701-4086-beb4-5863d8d92f6a"}], "security_groups": [{"name": "tempest-securitygroup--667437566"}], "key_name": "tempest-keypair-568347225", "user_data": "}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:24:40.048456 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-996ea15a-ffc8-4b99-9844-fcdffc9eb744 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] validate_networks() for [('68250cdd-7701-4086-beb4-5863d8d92f6a', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 28 10:24:40.426865 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-996ea15a-ffc8-4b99-9844-fcdffc9eb744 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 28 10:24:40.427312 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-996ea15a-ffc8-4b99-9844-fcdffc9eb744 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 28 10:24:40.427773 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-996ea15a-ffc8-4b99-9844-fcdffc9eb744 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 28 10:24:40.428140 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-996ea15a-ffc8-4b99-9844-fcdffc9eb744 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 28 10:24:40.428613 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-996ea15a-ffc8-4b99-9844-fcdffc9eb744 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 28 10:24:40.437326 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-996ea15a-ffc8-4b99-9844-fcdffc9eb744 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:40.437804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-996ea15a-ffc8-4b99-9844-fcdffc9eb744 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:40.438228 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-996ea15a-ffc8-4b99-9844-fcdffc9eb744 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:40.438940 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-996ea15a-ffc8-4b99-9844-fcdffc9eb744 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:40.439375 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-996ea15a-ffc8-4b99-9844-fcdffc9eb744 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:40.439791 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-996ea15a-ffc8-4b99-9844-fcdffc9eb744 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:40.456018 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-996ea15a-ffc8-4b99-9844-fcdffc9eb744 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Getting quotas for project eefcb341ab8d4823a95c5bce47395083. Resources: {'instances', 'cores', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:24:40.459904 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-996ea15a-ffc8-4b99-9844-fcdffc9eb744 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Getting quotas for user ed4711b7691643109007e173fee1c405 and project eefcb341ab8d4823a95c5bce47395083. Resources: {'instances', 'cores', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:24:40.470733 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-996ea15a-ffc8-4b99-9844-fcdffc9eb744 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 28 10:24:40.473080 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-996ea15a-ffc8-4b99-9844-fcdffc9eb744 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2780c39b-8bd3-4e73-9669-2b2e29474f3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 28 10:24:40.538005 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-996ea15a-ffc8-4b99-9844-fcdffc9eb744 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.601449 Aug 28 10:24:40.538810 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 437/859] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Aug 28 10:24:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 28 10:24:40.551740 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-9af9ae71-c7e3-4271-9b18-144aeeddc346 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:40.552350 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-9af9ae71-c7e3-4271-9b18-144aeeddc346 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:40.622155 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-9af9ae71-c7e3-4271-9b18-144aeeddc346 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:40.630761 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-9af9ae71-c7e3-4271-9b18-144aeeddc346 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942" status: 200 len: 1241 microversion: 2.1 time: 0.082716 Aug 28 10:24:40.631499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 423/860] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:40 2022] GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:40.918996 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5af1f003-02e6-4614-9e71-83cd90c64105 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:40.919990 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5af1f003-02e6-4614-9e71-83cd90c64105 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:40.927357 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5af1f003-02e6-4614-9e71-83cd90c64105 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:40.927857 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5af1f003-02e6-4614-9e71-83cd90c64105 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:40.928526 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5af1f003-02e6-4614-9e71-83cd90c64105 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:40.929610 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5af1f003-02e6-4614-9e71-83cd90c64105 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:40.930519 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5af1f003-02e6-4614-9e71-83cd90c64105 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:40.930938 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5af1f003-02e6-4614-9e71-83cd90c64105 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:41.068641 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5af1f003-02e6-4614-9e71-83cd90c64105 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:41.078738 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5af1f003-02e6-4614-9e71-83cd90c64105 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:41.080491 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5af1f003-02e6-4614-9e71-83cd90c64105 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:41.081847 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5af1f003-02e6-4614-9e71-83cd90c64105 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1722 microversion: 2.20 time: 0.167405 Aug 28 10:24:41.082514 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 438/861] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:40 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:41.655113 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-187453e4-524b-4a2f-bd4d-0329c991f9fc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:41.655863 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-187453e4-524b-4a2f-bd4d-0329c991f9fc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:41.663215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-187453e4-524b-4a2f-bd4d-0329c991f9fc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:41.663723 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-187453e4-524b-4a2f-bd4d-0329c991f9fc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:41.664272 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-187453e4-524b-4a2f-bd4d-0329c991f9fc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:41.665408 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-187453e4-524b-4a2f-bd4d-0329c991f9fc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:41.665959 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-187453e4-524b-4a2f-bd4d-0329c991f9fc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:41.666401 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-187453e4-524b-4a2f-bd4d-0329c991f9fc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:41.735056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-187453e4-524b-4a2f-bd4d-0329c991f9fc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:41.743060 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-187453e4-524b-4a2f-bd4d-0329c991f9fc tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942" status: 200 len: 1293 microversion: 2.1 time: 0.092303 Aug 28 10:24:41.743732 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 424/862] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:41 2022] GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:42.104796 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f06d8783-6103-417e-887c-60914588c32b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:42.105385 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f06d8783-6103-417e-887c-60914588c32b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:42.111886 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f06d8783-6103-417e-887c-60914588c32b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:42.112374 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f06d8783-6103-417e-887c-60914588c32b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:42.112866 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f06d8783-6103-417e-887c-60914588c32b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:42.113558 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f06d8783-6103-417e-887c-60914588c32b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:42.114045 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f06d8783-6103-417e-887c-60914588c32b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:42.114464 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f06d8783-6103-417e-887c-60914588c32b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:42.251651 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f06d8783-6103-417e-887c-60914588c32b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:42.261541 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f06d8783-6103-417e-887c-60914588c32b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:42.263916 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f06d8783-6103-417e-887c-60914588c32b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:42.265440 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f06d8783-6103-417e-887c-60914588c32b tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1743 microversion: 2.20 time: 0.164588 Aug 28 10:24:42.268671 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 439/863] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:42 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:42.768108 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-516042e2-ff8e-4f78-8965-ec6a1ef2bc2e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:42.768818 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-516042e2-ff8e-4f78-8965-ec6a1ef2bc2e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:42.776372 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-516042e2-ff8e-4f78-8965-ec6a1ef2bc2e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:42.776884 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-516042e2-ff8e-4f78-8965-ec6a1ef2bc2e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:42.777330 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-516042e2-ff8e-4f78-8965-ec6a1ef2bc2e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:42.778046 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-516042e2-ff8e-4f78-8965-ec6a1ef2bc2e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:42.778498 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-516042e2-ff8e-4f78-8965-ec6a1ef2bc2e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:42.778918 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-516042e2-ff8e-4f78-8965-ec6a1ef2bc2e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:42.969904 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-516042e2-ff8e-4f78-8965-ec6a1ef2bc2e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:42.978839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-516042e2-ff8e-4f78-8965-ec6a1ef2bc2e tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942" status: 200 len: 1366 microversion: 2.1 time: 0.214989 Aug 28 10:24:42.991966 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 425/864] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:42 2022] GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:43.291130 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4422aa66-702a-4c46-9478-e6b238395c2a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:43.291726 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4422aa66-702a-4c46-9478-e6b238395c2a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:43.300091 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4422aa66-702a-4c46-9478-e6b238395c2a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:43.300806 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4422aa66-702a-4c46-9478-e6b238395c2a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:43.301289 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4422aa66-702a-4c46-9478-e6b238395c2a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:43.302146 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4422aa66-702a-4c46-9478-e6b238395c2a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:43.302618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4422aa66-702a-4c46-9478-e6b238395c2a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:43.303029 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4422aa66-702a-4c46-9478-e6b238395c2a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:43.439538 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-88f20d26-3c5e-4533-82d9-561bff11de97 req-7e0bec87-f815-4bb3-816c-75bf162a6065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78ef862a-38f7-47f6-b474-1b997aa89942", "tag": "b98fe54c-b992-4412-a762-eb682c5e50d5"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:24:43.480596 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-88f20d26-3c5e-4533-82d9-561bff11de97 req-7e0bec87-f815-4bb3-816c-75bf162a6065 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:43.481174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-88f20d26-3c5e-4533-82d9-561bff11de97 req-7e0bec87-f815-4bb3-816c-75bf162a6065 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:43.481708 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-88f20d26-3c5e-4533-82d9-561bff11de97 req-7e0bec87-f815-4bb3-816c-75bf162a6065 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:43.495324 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4422aa66-702a-4c46-9478-e6b238395c2a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:43.506497 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4422aa66-702a-4c46-9478-e6b238395c2a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:43.508377 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4422aa66-702a-4c46-9478-e6b238395c2a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:43.509492 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-88f20d26-3c5e-4533-82d9-561bff11de97 req-7e0bec87-f815-4bb3-816c-75bf162a6065 service nova] Creating event network-changed:b98fe54c-b992-4412-a762-eb682c5e50d5 for instance 78ef862a-38f7-47f6-b474-1b997aa89942 on hv-cinder-85200 Aug 28 10:24:43.509952 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4422aa66-702a-4c46-9478-e6b238395c2a tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1743 microversion: 2.20 time: 0.222691 Aug 28 10:24:43.510786 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 440/865] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:43 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1743 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:43.526053 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-88f20d26-3c5e-4533-82d9-561bff11de97 req-7e0bec87-f815-4bb3-816c-75bf162a6065 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092351 Aug 28 10:24:43.527366 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 426/866] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:24:43.999886 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-33cad5c1-b4ac-4398-8201-9a64cb2da3d6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:44.000539 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-33cad5c1-b4ac-4398-8201-9a64cb2da3d6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:44.008082 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-33cad5c1-b4ac-4398-8201-9a64cb2da3d6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:44.008979 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-33cad5c1-b4ac-4398-8201-9a64cb2da3d6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:44.009412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-33cad5c1-b4ac-4398-8201-9a64cb2da3d6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:44.010306 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-33cad5c1-b4ac-4398-8201-9a64cb2da3d6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:44.010766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-33cad5c1-b4ac-4398-8201-9a64cb2da3d6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:44.011185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-33cad5c1-b4ac-4398-8201-9a64cb2da3d6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:44.143481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-33cad5c1-b4ac-4398-8201-9a64cb2da3d6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:44.151099 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-33cad5c1-b4ac-4398-8201-9a64cb2da3d6 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942" status: 200 len: 1366 microversion: 2.1 time: 0.155461 Aug 28 10:24:44.152009 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 441/867] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:43 2022] GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:44.537750 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-cc7856ed-d14c-4cfc-a7e2-c28478445eec tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:44.538441 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-cc7856ed-d14c-4cfc-a7e2-c28478445eec tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:44.547669 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cc7856ed-d14c-4cfc-a7e2-c28478445eec tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:44.548156 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cc7856ed-d14c-4cfc-a7e2-c28478445eec tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:44.548644 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cc7856ed-d14c-4cfc-a7e2-c28478445eec tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:44.549733 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cc7856ed-d14c-4cfc-a7e2-c28478445eec tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:44.550205 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cc7856ed-d14c-4cfc-a7e2-c28478445eec tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:44.550618 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cc7856ed-d14c-4cfc-a7e2-c28478445eec tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:44.641194 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-67495e2a-9e5d-4db2-907a-6e3bd5942e0f req-2c0d7814-f7fe-4d90-80e2-fcf691256db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6960433f-4e91-4c5b-9c8e-50645b6e13e7", "name": "network-vif-plugged", "status": "completed", "tag": "609522cc-a982-46e3-bc01-474519fee148"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:24:44.653342 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-67495e2a-9e5d-4db2-907a-6e3bd5942e0f req-2c0d7814-f7fe-4d90-80e2-fcf691256db8 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:44.654036 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-67495e2a-9e5d-4db2-907a-6e3bd5942e0f req-2c0d7814-f7fe-4d90-80e2-fcf691256db8 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:44.654458 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-67495e2a-9e5d-4db2-907a-6e3bd5942e0f req-2c0d7814-f7fe-4d90-80e2-fcf691256db8 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:44.667435 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-67495e2a-9e5d-4db2-907a-6e3bd5942e0f req-2c0d7814-f7fe-4d90-80e2-fcf691256db8 service nova] Creating event network-vif-plugged:609522cc-a982-46e3-bc01-474519fee148 for instance 6960433f-4e91-4c5b-9c8e-50645b6e13e7 on hv-cinder-85200 Aug 28 10:24:44.673198 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-67495e2a-9e5d-4db2-907a-6e3bd5942e0f req-2c0d7814-f7fe-4d90-80e2-fcf691256db8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035691 Aug 28 10:24:44.674004 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 442/868] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:24:44.761577 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-cc7856ed-d14c-4cfc-a7e2-c28478445eec tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:44.771258 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-cc7856ed-d14c-4cfc-a7e2-c28478445eec tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:44.772948 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-cc7856ed-d14c-4cfc-a7e2-c28478445eec tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:44.774752 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-cc7856ed-d14c-4cfc-a7e2-c28478445eec tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1743 microversion: 2.20 time: 0.241039 Aug 28 10:24:44.786345 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 427/869] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:44 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1743 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:45.173511 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-79e7604b-bcab-4e39-a1ae-87f87cb718b2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:45.174450 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-79e7604b-bcab-4e39-a1ae-87f87cb718b2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:45.181889 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-79e7604b-bcab-4e39-a1ae-87f87cb718b2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:45.182356 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-79e7604b-bcab-4e39-a1ae-87f87cb718b2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:45.182987 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-79e7604b-bcab-4e39-a1ae-87f87cb718b2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:45.183689 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-79e7604b-bcab-4e39-a1ae-87f87cb718b2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:45.184142 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-79e7604b-bcab-4e39-a1ae-87f87cb718b2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:45.184583 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-79e7604b-bcab-4e39-a1ae-87f87cb718b2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:45.328141 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-79e7604b-bcab-4e39-a1ae-87f87cb718b2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:45.350196 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-79e7604b-bcab-4e39-a1ae-87f87cb718b2 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942" status: 200 len: 1366 microversion: 2.1 time: 0.182285 Aug 28 10:24:45.351468 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 443/870] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:45 2022] GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:45.797939 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-544e410e-0d7a-45c3-9895-a54c0674aebd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:45.798595 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-544e410e-0d7a-45c3-9895-a54c0674aebd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:45.805261 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-544e410e-0d7a-45c3-9895-a54c0674aebd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:45.805729 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-544e410e-0d7a-45c3-9895-a54c0674aebd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:45.806199 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-544e410e-0d7a-45c3-9895-a54c0674aebd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:45.806877 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-544e410e-0d7a-45c3-9895-a54c0674aebd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:45.807319 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-544e410e-0d7a-45c3-9895-a54c0674aebd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:45.807803 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-544e410e-0d7a-45c3-9895-a54c0674aebd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:45.940633 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-544e410e-0d7a-45c3-9895-a54c0674aebd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:45.949182 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-544e410e-0d7a-45c3-9895-a54c0674aebd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:45.950630 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-544e410e-0d7a-45c3-9895-a54c0674aebd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:45.951768 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-544e410e-0d7a-45c3-9895-a54c0674aebd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1743 microversion: 2.20 time: 0.158126 Aug 28 10:24:45.952336 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 428/871] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:45 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:46.375551 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-df21db8f-087a-478d-8887-c51792594d5a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:46.376605 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-df21db8f-087a-478d-8887-c51792594d5a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:46.387354 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-df21db8f-087a-478d-8887-c51792594d5a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:46.388148 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-df21db8f-087a-478d-8887-c51792594d5a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:46.388910 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-df21db8f-087a-478d-8887-c51792594d5a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:46.390041 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-df21db8f-087a-478d-8887-c51792594d5a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:46.390783 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-df21db8f-087a-478d-8887-c51792594d5a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:46.391474 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-df21db8f-087a-478d-8887-c51792594d5a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:46.786423 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-df21db8f-087a-478d-8887-c51792594d5a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:46.794931 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-df21db8f-087a-478d-8887-c51792594d5a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942" status: 200 len: 1366 microversion: 2.1 time: 0.425841 Aug 28 10:24:46.795629 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 444/872] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:46 2022] GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 => generated 1366 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:46.870427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e062c9a6-6f47-4b11-98ae-35125d782951 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1899128861", "imageRef": "2780c39b-8bd3-4e73-9669-2b2e29474f3e", "flavorRef": "452", "networks": [{"uuid": "3c7bda95-5a0f-4fa1-b22e-fa05711e7756"}]}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:24:46.927197 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.network.neutron [None req-e062c9a6-6f47-4b11-98ae-35125d782951 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] validate_networks() for [('3c7bda95-5a0f-4fa1-b22e-fa05711e7756', None, None, None, None, None)] {{(pid=120664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 28 10:24:46.982605 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c2b35cf0-d727-416c-b3e6-9edef76a40b8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:46.983237 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c2b35cf0-d727-416c-b3e6-9edef76a40b8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:46.989493 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c2b35cf0-d727-416c-b3e6-9edef76a40b8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:46.989970 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c2b35cf0-d727-416c-b3e6-9edef76a40b8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:46.990394 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c2b35cf0-d727-416c-b3e6-9edef76a40b8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:46.991058 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c2b35cf0-d727-416c-b3e6-9edef76a40b8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:46.991534 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c2b35cf0-d727-416c-b3e6-9edef76a40b8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:46.991950 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c2b35cf0-d727-416c-b3e6-9edef76a40b8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:47.203368 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c2b35cf0-d727-416c-b3e6-9edef76a40b8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:47.212049 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c2b35cf0-d727-416c-b3e6-9edef76a40b8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:47.213747 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c2b35cf0-d727-416c-b3e6-9edef76a40b8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:47.215358 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c2b35cf0-d727-416c-b3e6-9edef76a40b8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1743 microversion: 2.20 time: 0.236700 Aug 28 10:24:47.220548 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 445/873] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:46 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1743 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:47.339396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-e062c9a6-6f47-4b11-98ae-35125d782951 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Flavor limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 28 10:24:47.339925 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-e062c9a6-6f47-4b11-98ae-35125d782951 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Image limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 28 10:24:47.340521 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-e062c9a6-6f47-4b11-98ae-35125d782951 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Flavor pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 28 10:24:47.340989 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-e062c9a6-6f47-4b11-98ae-35125d782951 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Image pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 28 10:24:47.341575 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-e062c9a6-6f47-4b11-98ae-35125d782951 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 28 10:24:47.350658 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e062c9a6-6f47-4b11-98ae-35125d782951 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:47.351198 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e062c9a6-6f47-4b11-98ae-35125d782951 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:47.351692 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e062c9a6-6f47-4b11-98ae-35125d782951 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:47.352597 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e062c9a6-6f47-4b11-98ae-35125d782951 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:47.353108 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e062c9a6-6f47-4b11-98ae-35125d782951 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:47.353592 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e062c9a6-6f47-4b11-98ae-35125d782951 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:47.370518 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-e062c9a6-6f47-4b11-98ae-35125d782951 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Getting quotas for project 75e24ec2c109424ab964b4d441db44e7. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:24:47.374599 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-e062c9a6-6f47-4b11-98ae-35125d782951 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Getting quotas for user b661e219b74f436bb668806a547f4778 and project 75e24ec2c109424ab964b4d441db44e7. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:24:47.385324 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e062c9a6-6f47-4b11-98ae-35125d782951 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Going to run 1 instances... {{(pid=120664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 28 10:24:47.387707 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e062c9a6-6f47-4b11-98ae-35125d782951 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: fc2d1762-d7f5-4ac5-81c5-0888546a210e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2780c39b-8bd3-4e73-9669-2b2e29474f3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 28 10:24:47.439583 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-e062c9a6-6f47-4b11-98ae-35125d782951 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575060 Aug 28 10:24:47.445964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 429/874] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Aug 28 10:24:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 28 10:24:47.451229 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8b65ac19-ee56-4bfb-ab7c-8c6a7ad82b06 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:47.452404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8b65ac19-ee56-4bfb-ab7c-8c6a7ad82b06 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: fc2d1762-d7f5-4ac5-81c5-0888546a210e] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:47.512213 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8b65ac19-ee56-4bfb-ab7c-8c6a7ad82b06 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:47.519934 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8b65ac19-ee56-4bfb-ab7c-8c6a7ad82b06 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e" status: 200 len: 1214 microversion: 2.1 time: 0.072690 Aug 28 10:24:47.520801 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 446/875] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:47 2022] GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:47.816299 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-dc194bdf-8d72-4cf6-affd-4b224188a639 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:47.816957 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-dc194bdf-8d72-4cf6-affd-4b224188a639 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:47.824124 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-dc194bdf-8d72-4cf6-affd-4b224188a639 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:47.824641 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-dc194bdf-8d72-4cf6-affd-4b224188a639 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:47.825112 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-dc194bdf-8d72-4cf6-affd-4b224188a639 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:47.825808 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-dc194bdf-8d72-4cf6-affd-4b224188a639 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:47.826283 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-dc194bdf-8d72-4cf6-affd-4b224188a639 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:47.826682 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-dc194bdf-8d72-4cf6-affd-4b224188a639 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:47.967680 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-dc194bdf-8d72-4cf6-affd-4b224188a639 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:47.975726 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-dc194bdf-8d72-4cf6-affd-4b224188a639 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942" status: 200 len: 1366 microversion: 2.1 time: 0.163566 Aug 28 10:24:47.976233 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 430/876] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:47 2022] GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:48.239778 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c0cab6b5-982b-4ddc-a51e-1eb44ea6c096 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:48.240307 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c0cab6b5-982b-4ddc-a51e-1eb44ea6c096 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:48.247039 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0cab6b5-982b-4ddc-a51e-1eb44ea6c096 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:48.247534 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0cab6b5-982b-4ddc-a51e-1eb44ea6c096 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:48.247953 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0cab6b5-982b-4ddc-a51e-1eb44ea6c096 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:48.248669 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0cab6b5-982b-4ddc-a51e-1eb44ea6c096 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:48.249110 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0cab6b5-982b-4ddc-a51e-1eb44ea6c096 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:48.249520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0cab6b5-982b-4ddc-a51e-1eb44ea6c096 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:48.391738 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c0cab6b5-982b-4ddc-a51e-1eb44ea6c096 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:48.399910 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c0cab6b5-982b-4ddc-a51e-1eb44ea6c096 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:48.401511 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c0cab6b5-982b-4ddc-a51e-1eb44ea6c096 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:48.402596 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c0cab6b5-982b-4ddc-a51e-1eb44ea6c096 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1738 microversion: 2.20 time: 0.167021 Aug 28 10:24:48.403357 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 447/877] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:48 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:48.540128 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-1d31d98f-faf2-456b-a70c-31bd61490856 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:48.540786 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-1d31d98f-faf2-456b-a70c-31bd61490856 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: fc2d1762-d7f5-4ac5-81c5-0888546a210e] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:48.547671 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1d31d98f-faf2-456b-a70c-31bd61490856 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:48.548147 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1d31d98f-faf2-456b-a70c-31bd61490856 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:48.548602 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1d31d98f-faf2-456b-a70c-31bd61490856 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:48.549281 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1d31d98f-faf2-456b-a70c-31bd61490856 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:48.549720 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1d31d98f-faf2-456b-a70c-31bd61490856 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:48.550134 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1d31d98f-faf2-456b-a70c-31bd61490856 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:48.622280 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-1d31d98f-faf2-456b-a70c-31bd61490856 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:48.630226 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-1d31d98f-faf2-456b-a70c-31bd61490856 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e" status: 200 len: 1266 microversion: 2.1 time: 0.094068 Aug 28 10:24:48.630802 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 431/878] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:48 2022] GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:48.996055 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f19f8677-aa79-415b-a09b-3f9a308d9e31 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:48.996694 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f19f8677-aa79-415b-a09b-3f9a308d9e31 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:49.002995 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f19f8677-aa79-415b-a09b-3f9a308d9e31 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:49.003737 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f19f8677-aa79-415b-a09b-3f9a308d9e31 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:49.004332 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f19f8677-aa79-415b-a09b-3f9a308d9e31 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:49.005203 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f19f8677-aa79-415b-a09b-3f9a308d9e31 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:49.005798 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f19f8677-aa79-415b-a09b-3f9a308d9e31 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:49.006367 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f19f8677-aa79-415b-a09b-3f9a308d9e31 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:49.158426 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f19f8677-aa79-415b-a09b-3f9a308d9e31 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:49.166954 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f19f8677-aa79-415b-a09b-3f9a308d9e31 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942" status: 200 len: 1366 microversion: 2.1 time: 0.174682 Aug 28 10:24:49.167914 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 448/879] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:48 2022] GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:49.428206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-72f2bf57-f383-4ad9-bdcf-59eee5ae2064 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:49.429903 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-72f2bf57-f383-4ad9-bdcf-59eee5ae2064 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:49.442329 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-72f2bf57-f383-4ad9-bdcf-59eee5ae2064 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:49.443282 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-72f2bf57-f383-4ad9-bdcf-59eee5ae2064 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:49.443955 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-72f2bf57-f383-4ad9-bdcf-59eee5ae2064 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:49.444934 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-72f2bf57-f383-4ad9-bdcf-59eee5ae2064 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:49.445711 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-72f2bf57-f383-4ad9-bdcf-59eee5ae2064 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:49.446638 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-72f2bf57-f383-4ad9-bdcf-59eee5ae2064 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:49.619619 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-72f2bf57-f383-4ad9-bdcf-59eee5ae2064 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:49.630451 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-72f2bf57-f383-4ad9-bdcf-59eee5ae2064 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:49.632184 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-72f2bf57-f383-4ad9-bdcf-59eee5ae2064 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:49.634090 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-72f2bf57-f383-4ad9-bdcf-59eee5ae2064 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1738 microversion: 2.20 time: 0.211993 Aug 28 10:24:49.648651 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 432/880] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:49 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:49.652235 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-98b1bf04-376f-42c0-81b2-f1f287660b8a tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:49.652864 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-98b1bf04-376f-42c0-81b2-f1f287660b8a tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: fc2d1762-d7f5-4ac5-81c5-0888546a210e] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:49.659703 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98b1bf04-376f-42c0-81b2-f1f287660b8a tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:49.660569 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98b1bf04-376f-42c0-81b2-f1f287660b8a tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:49.661169 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98b1bf04-376f-42c0-81b2-f1f287660b8a tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:49.662465 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98b1bf04-376f-42c0-81b2-f1f287660b8a tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:49.662988 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98b1bf04-376f-42c0-81b2-f1f287660b8a tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:49.663632 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98b1bf04-376f-42c0-81b2-f1f287660b8a tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:49.835575 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-98b1bf04-376f-42c0-81b2-f1f287660b8a tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:49.845715 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-98b1bf04-376f-42c0-81b2-f1f287660b8a tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e" status: 200 len: 1314 microversion: 2.1 time: 0.198834 Aug 28 10:24:49.847619 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 449/881] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:49 2022] GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:50.188054 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-2ba6dc20-39c8-45e8-8afe-4dfecb4b0ac5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:50.188696 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-2ba6dc20-39c8-45e8-8afe-4dfecb4b0ac5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:50.196471 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2ba6dc20-39c8-45e8-8afe-4dfecb4b0ac5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:50.197387 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2ba6dc20-39c8-45e8-8afe-4dfecb4b0ac5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:50.198065 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2ba6dc20-39c8-45e8-8afe-4dfecb4b0ac5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:50.198979 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2ba6dc20-39c8-45e8-8afe-4dfecb4b0ac5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:50.199636 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2ba6dc20-39c8-45e8-8afe-4dfecb4b0ac5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:50.200268 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2ba6dc20-39c8-45e8-8afe-4dfecb4b0ac5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:50.320322 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-6882fe0f-0dbf-4e6b-90ab-410a392dc340 req-aae6968c-b97a-4fbb-a2e1-0b0bf0edf212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc2d1762-d7f5-4ac5-81c5-0888546a210e", "tag": "952c9374-593e-4283-b660-bd891405b43b"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:24:50.348524 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-6882fe0f-0dbf-4e6b-90ab-410a392dc340 req-aae6968c-b97a-4fbb-a2e1-0b0bf0edf212 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:50.349270 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-6882fe0f-0dbf-4e6b-90ab-410a392dc340 req-aae6968c-b97a-4fbb-a2e1-0b0bf0edf212 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:50.349889 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-6882fe0f-0dbf-4e6b-90ab-410a392dc340 req-aae6968c-b97a-4fbb-a2e1-0b0bf0edf212 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:50.364410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-6882fe0f-0dbf-4e6b-90ab-410a392dc340 req-aae6968c-b97a-4fbb-a2e1-0b0bf0edf212 service nova] Creating event network-changed:952c9374-593e-4283-b660-bd891405b43b for instance fc2d1762-d7f5-4ac5-81c5-0888546a210e on hv-cinder-85200 Aug 28 10:24:50.369664 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-6882fe0f-0dbf-4e6b-90ab-410a392dc340 req-aae6968c-b97a-4fbb-a2e1-0b0bf0edf212 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053075 Aug 28 10:24:50.370370 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 450/882] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:24:50.417538 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-2ba6dc20-39c8-45e8-8afe-4dfecb4b0ac5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:50.428225 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-2ba6dc20-39c8-45e8-8afe-4dfecb4b0ac5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942" status: 200 len: 1366 microversion: 2.1 time: 0.244475 Aug 28 10:24:50.433220 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 433/883] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:50 2022] GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:50.655723 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:24:50.660211 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fcb6f400-d8c4-41e3-a711-d9268249fa0c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:50.660787 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fcb6f400-d8c4-41e3-a711-d9268249fa0c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:50.671439 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fcb6f400-d8c4-41e3-a711-d9268249fa0c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:50.673410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fcb6f400-d8c4-41e3-a711-d9268249fa0c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:50.674090 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fcb6f400-d8c4-41e3-a711-d9268249fa0c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:50.675152 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fcb6f400-d8c4-41e3-a711-d9268249fa0c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:50.675604 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fcb6f400-d8c4-41e3-a711-d9268249fa0c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:50.676701 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fcb6f400-d8c4-41e3-a711-d9268249fa0c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:50.789310 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-c33a9a8b-3871-4f5d-806e-e4e6e50559a4 req-efe1d9b2-9b68-474a-a52a-c10daed5eaf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78ef862a-38f7-47f6-b474-1b997aa89942", "name": "network-vif-plugged", "status": "completed", "tag": "b98fe54c-b992-4412-a762-eb682c5e50d5"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:24:50.803833 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-c33a9a8b-3871-4f5d-806e-e4e6e50559a4 req-efe1d9b2-9b68-474a-a52a-c10daed5eaf6 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:50.804585 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-c33a9a8b-3871-4f5d-806e-e4e6e50559a4 req-efe1d9b2-9b68-474a-a52a-c10daed5eaf6 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:50.805167 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-c33a9a8b-3871-4f5d-806e-e4e6e50559a4 req-efe1d9b2-9b68-474a-a52a-c10daed5eaf6 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:50.835143 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-c33a9a8b-3871-4f5d-806e-e4e6e50559a4 req-efe1d9b2-9b68-474a-a52a-c10daed5eaf6 service nova] Creating event network-vif-plugged:b98fe54c-b992-4412-a762-eb682c5e50d5 for instance 78ef862a-38f7-47f6-b474-1b997aa89942 on hv-cinder-85200 Aug 28 10:24:50.849617 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-c33a9a8b-3871-4f5d-806e-e4e6e50559a4 req-efe1d9b2-9b68-474a-a52a-c10daed5eaf6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064886 Aug 28 10:24:50.850934 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 434/884] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:24:50.878196 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-9fb2c9ee-7bb1-4c0b-abd1-691f8418cb94 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:50.879338 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-9fb2c9ee-7bb1-4c0b-abd1-691f8418cb94 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: fc2d1762-d7f5-4ac5-81c5-0888546a210e] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:50.882153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fcb6f400-d8c4-41e3-a711-d9268249fa0c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:50.889041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9fb2c9ee-7bb1-4c0b-abd1-691f8418cb94 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:50.890244 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9fb2c9ee-7bb1-4c0b-abd1-691f8418cb94 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:50.890913 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9fb2c9ee-7bb1-4c0b-abd1-691f8418cb94 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:50.891777 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9fb2c9ee-7bb1-4c0b-abd1-691f8418cb94 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:50.892395 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9fb2c9ee-7bb1-4c0b-abd1-691f8418cb94 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:50.892535 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fcb6f400-d8c4-41e3-a711-d9268249fa0c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:50.893436 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9fb2c9ee-7bb1-4c0b-abd1-691f8418cb94 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:50.894150 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fcb6f400-d8c4-41e3-a711-d9268249fa0c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:50.895677 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fcb6f400-d8c4-41e3-a711-d9268249fa0c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1738 microversion: 2.20 time: 0.240940 Aug 28 10:24:50.896918 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 451/885] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:50 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1738 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:51.060433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-9fb2c9ee-7bb1-4c0b-abd1-691f8418cb94 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:51.068800 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-9fb2c9ee-7bb1-4c0b-abd1-691f8418cb94 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e" status: 200 len: 1314 microversion: 2.1 time: 0.201857 Aug 28 10:24:51.069805 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 435/886] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:50 2022] GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:51.455205 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-763e25e2-5bab-4131-8513-7d4ffb56a5c5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:51.456309 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-763e25e2-5bab-4131-8513-7d4ffb56a5c5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:51.462939 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-763e25e2-5bab-4131-8513-7d4ffb56a5c5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:51.463423 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-763e25e2-5bab-4131-8513-7d4ffb56a5c5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:51.463893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-763e25e2-5bab-4131-8513-7d4ffb56a5c5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:51.465109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-763e25e2-5bab-4131-8513-7d4ffb56a5c5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:51.465673 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-763e25e2-5bab-4131-8513-7d4ffb56a5c5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:51.466111 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-763e25e2-5bab-4131-8513-7d4ffb56a5c5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:51.618196 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-763e25e2-5bab-4131-8513-7d4ffb56a5c5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:51.626611 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-763e25e2-5bab-4131-8513-7d4ffb56a5c5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942" status: 200 len: 1366 microversion: 2.1 time: 0.175180 Aug 28 10:24:51.627201 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 452/887] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:51 2022] GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:51.921596 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-30079569-68c0-4c34-acda-b3af15203c92 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:51.922198 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-30079569-68c0-4c34-acda-b3af15203c92 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:51.928439 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-30079569-68c0-4c34-acda-b3af15203c92 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:51.928976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-30079569-68c0-4c34-acda-b3af15203c92 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:51.929399 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-30079569-68c0-4c34-acda-b3af15203c92 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:51.930093 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-30079569-68c0-4c34-acda-b3af15203c92 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:51.930524 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-30079569-68c0-4c34-acda-b3af15203c92 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:51.930939 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-30079569-68c0-4c34-acda-b3af15203c92 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:52.076858 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-30079569-68c0-4c34-acda-b3af15203c92 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:52.089915 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cc1888ef-d947-4b70-8fde-e5e8f6059446 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:52.090618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cc1888ef-d947-4b70-8fde-e5e8f6059446 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: fc2d1762-d7f5-4ac5-81c5-0888546a210e] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:52.094080 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-30079569-68c0-4c34-acda-b3af15203c92 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:52.097291 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-30079569-68c0-4c34-acda-b3af15203c92 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:52.098976 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc1888ef-d947-4b70-8fde-e5e8f6059446 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:52.099444 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc1888ef-d947-4b70-8fde-e5e8f6059446 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:52.099864 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc1888ef-d947-4b70-8fde-e5e8f6059446 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:52.100564 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc1888ef-d947-4b70-8fde-e5e8f6059446 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:52.100994 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc1888ef-d947-4b70-8fde-e5e8f6059446 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:52.101427 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc1888ef-d947-4b70-8fde-e5e8f6059446 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:52.118918 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-30079569-68c0-4c34-acda-b3af15203c92 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1738 microversion: 2.20 time: 0.191694 Aug 28 10:24:52.118918 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 436/888] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:51 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:52.151684 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:24:52.272346 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cc1888ef-d947-4b70-8fde-e5e8f6059446 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:52.282662 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cc1888ef-d947-4b70-8fde-e5e8f6059446 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e" status: 200 len: 1314 microversion: 2.1 time: 0.196412 Aug 28 10:24:52.285342 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 453/889] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:52 2022] GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:52.647185 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-50e3ebeb-558f-42c7-8d66-bd03eba3da4f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:52.647787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-50e3ebeb-558f-42c7-8d66-bd03eba3da4f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:52.655495 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-50e3ebeb-558f-42c7-8d66-bd03eba3da4f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:52.656298 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-50e3ebeb-558f-42c7-8d66-bd03eba3da4f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:52.656964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-50e3ebeb-558f-42c7-8d66-bd03eba3da4f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:52.657663 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-50e3ebeb-558f-42c7-8d66-bd03eba3da4f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:52.658114 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-50e3ebeb-558f-42c7-8d66-bd03eba3da4f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:52.658528 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-50e3ebeb-558f-42c7-8d66-bd03eba3da4f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:52.823112 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-50e3ebeb-558f-42c7-8d66-bd03eba3da4f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:52.833230 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-50e3ebeb-558f-42c7-8d66-bd03eba3da4f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942" status: 200 len: 1366 microversion: 2.1 time: 0.189658 Aug 28 10:24:52.834266 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 437/890] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:52 2022] GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:53.135407 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dfb37cbf-298e-450b-ad57-be071c62c261 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:53.136074 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-dfb37cbf-298e-450b-ad57-be071c62c261 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:53.143318 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfb37cbf-298e-450b-ad57-be071c62c261 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:53.143795 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfb37cbf-298e-450b-ad57-be071c62c261 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:53.144392 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfb37cbf-298e-450b-ad57-be071c62c261 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:53.145277 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfb37cbf-298e-450b-ad57-be071c62c261 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:53.145907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfb37cbf-298e-450b-ad57-be071c62c261 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:53.146316 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfb37cbf-298e-450b-ad57-be071c62c261 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:53.292380 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dfb37cbf-298e-450b-ad57-be071c62c261 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:53.303702 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f22a48b7-8a3c-4846-84c2-8e81ec363017 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:53.304292 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f22a48b7-8a3c-4846-84c2-8e81ec363017 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: fc2d1762-d7f5-4ac5-81c5-0888546a210e] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:53.309768 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dfb37cbf-298e-450b-ad57-be071c62c261 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:53.311179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dfb37cbf-298e-450b-ad57-be071c62c261 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:53.312331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-dfb37cbf-298e-450b-ad57-be071c62c261 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1738 microversion: 2.20 time: 0.180934 Aug 28 10:24:53.312446 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f22a48b7-8a3c-4846-84c2-8e81ec363017 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:53.313113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 454/891] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:53 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:53.313246 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f22a48b7-8a3c-4846-84c2-8e81ec363017 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:53.313570 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f22a48b7-8a3c-4846-84c2-8e81ec363017 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:53.314477 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f22a48b7-8a3c-4846-84c2-8e81ec363017 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:53.315132 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f22a48b7-8a3c-4846-84c2-8e81ec363017 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:53.315756 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f22a48b7-8a3c-4846-84c2-8e81ec363017 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:53.537152 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f22a48b7-8a3c-4846-84c2-8e81ec363017 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:53.551247 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f22a48b7-8a3c-4846-84c2-8e81ec363017 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e" status: 200 len: 1314 microversion: 2.1 time: 0.251799 Aug 28 10:24:53.552171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 438/892] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:53 2022] GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:53.855086 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-defe4278-8d23-4663-984c-309b0a86d039 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:53.856049 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-defe4278-8d23-4663-984c-309b0a86d039 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:53.864016 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-defe4278-8d23-4663-984c-309b0a86d039 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:53.864016 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-defe4278-8d23-4663-984c-309b0a86d039 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:53.864016 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-defe4278-8d23-4663-984c-309b0a86d039 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:53.864878 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-defe4278-8d23-4663-984c-309b0a86d039 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:53.865768 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-defe4278-8d23-4663-984c-309b0a86d039 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:53.866479 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-defe4278-8d23-4663-984c-309b0a86d039 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:54.040214 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-defe4278-8d23-4663-984c-309b0a86d039 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:54.049047 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-defe4278-8d23-4663-984c-309b0a86d039 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942" status: 200 len: 1366 microversion: 2.1 time: 0.198436 Aug 28 10:24:54.062030 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 455/893] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:53 2022] GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:54.336435 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-67ddfa62-31a9-4bdb-994d-18ba47bd5afa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:54.337110 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-67ddfa62-31a9-4bdb-994d-18ba47bd5afa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:54.344052 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-67ddfa62-31a9-4bdb-994d-18ba47bd5afa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:54.344600 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-67ddfa62-31a9-4bdb-994d-18ba47bd5afa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:54.345007 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-67ddfa62-31a9-4bdb-994d-18ba47bd5afa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:54.345697 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-67ddfa62-31a9-4bdb-994d-18ba47bd5afa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:54.346144 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-67ddfa62-31a9-4bdb-994d-18ba47bd5afa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:54.346564 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-67ddfa62-31a9-4bdb-994d-18ba47bd5afa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:54.498054 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-67ddfa62-31a9-4bdb-994d-18ba47bd5afa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:54.501826 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=100 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:24:54.508036 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-67ddfa62-31a9-4bdb-994d-18ba47bd5afa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:54.509828 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-67ddfa62-31a9-4bdb-994d-18ba47bd5afa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:54.511056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-67ddfa62-31a9-4bdb-994d-18ba47bd5afa tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1738 microversion: 2.20 time: 0.178598 Aug 28 10:24:54.511625 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 439/894] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:54 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:54.571469 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-40725e16-15b8-4dae-9cd1-7b8d2ffcc9b2 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:54.572029 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-40725e16-15b8-4dae-9cd1-7b8d2ffcc9b2 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: fc2d1762-d7f5-4ac5-81c5-0888546a210e] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:54.591514 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40725e16-15b8-4dae-9cd1-7b8d2ffcc9b2 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:54.592027 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40725e16-15b8-4dae-9cd1-7b8d2ffcc9b2 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:54.592464 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40725e16-15b8-4dae-9cd1-7b8d2ffcc9b2 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:54.598835 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40725e16-15b8-4dae-9cd1-7b8d2ffcc9b2 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:54.599337 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40725e16-15b8-4dae-9cd1-7b8d2ffcc9b2 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:54.599773 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40725e16-15b8-4dae-9cd1-7b8d2ffcc9b2 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:54.809730 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-40725e16-15b8-4dae-9cd1-7b8d2ffcc9b2 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:54.820089 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-40725e16-15b8-4dae-9cd1-7b8d2ffcc9b2 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e" status: 200 len: 1314 microversion: 2.1 time: 0.252428 Aug 28 10:24:54.822420 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 456/895] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:54 2022] GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:55.070792 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-7f87a84e-3361-412a-8faa-f785cebd2fff tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:55.071140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-7f87a84e-3361-412a-8faa-f785cebd2fff tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:55.079347 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7f87a84e-3361-412a-8faa-f785cebd2fff tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:55.079985 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7f87a84e-3361-412a-8faa-f785cebd2fff tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:55.080477 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7f87a84e-3361-412a-8faa-f785cebd2fff tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:55.081273 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7f87a84e-3361-412a-8faa-f785cebd2fff tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:55.081801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7f87a84e-3361-412a-8faa-f785cebd2fff tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:55.082373 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7f87a84e-3361-412a-8faa-f785cebd2fff tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:55.228220 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7f87a84e-3361-412a-8faa-f785cebd2fff tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:55.237782 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-7f87a84e-3361-412a-8faa-f785cebd2fff tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942" status: 200 len: 1555 microversion: 2.1 time: 0.171687 Aug 28 10:24:55.238745 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 440/896] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:55 2022] GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:55.258942 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d16e0eaa-b041-4cce-871c-1b3d3ae8851d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:55.260770 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d16e0eaa-b041-4cce-871c-1b3d3ae8851d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:55.269693 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d16e0eaa-b041-4cce-871c-1b3d3ae8851d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:55.270178 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d16e0eaa-b041-4cce-871c-1b3d3ae8851d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:55.270613 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d16e0eaa-b041-4cce-871c-1b3d3ae8851d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:55.271462 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d16e0eaa-b041-4cce-871c-1b3d3ae8851d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:55.271918 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d16e0eaa-b041-4cce-871c-1b3d3ae8851d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:55.272334 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d16e0eaa-b041-4cce-871c-1b3d3ae8851d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:55.370099 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d16e0eaa-b041-4cce-871c-1b3d3ae8851d tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116254 Aug 28 10:24:55.371051 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 457/897] 10.222.0.40 () {58 vars in 1275 bytes} [Sun Aug 28 10:24:55 2022] GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:24:55.534365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-04e501d4-9c99-4bf0-9bd2-495d524de2cb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:55.534987 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-04e501d4-9c99-4bf0-9bd2-495d524de2cb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:55.554543 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-04e501d4-9c99-4bf0-9bd2-495d524de2cb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:55.555357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-04e501d4-9c99-4bf0-9bd2-495d524de2cb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:55.555788 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-04e501d4-9c99-4bf0-9bd2-495d524de2cb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:55.556541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-04e501d4-9c99-4bf0-9bd2-495d524de2cb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:55.556982 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-04e501d4-9c99-4bf0-9bd2-495d524de2cb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:55.557441 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-04e501d4-9c99-4bf0-9bd2-495d524de2cb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:55.787793 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-04e501d4-9c99-4bf0-9bd2-495d524de2cb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:55.797763 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-04e501d4-9c99-4bf0-9bd2-495d524de2cb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:55.800943 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-04e501d4-9c99-4bf0-9bd2-495d524de2cb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:55.802527 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-04e501d4-9c99-4bf0-9bd2-495d524de2cb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1738 microversion: 2.20 time: 0.272941 Aug 28 10:24:55.803290 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 441/898] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:55 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1738 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:55.845069 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0c17168e-a332-4e08-8801-fabcbf70a944 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:55.846441 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0c17168e-a332-4e08-8801-fabcbf70a944 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: fc2d1762-d7f5-4ac5-81c5-0888546a210e] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:55.852865 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0c17168e-a332-4e08-8801-fabcbf70a944 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:55.853626 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0c17168e-a332-4e08-8801-fabcbf70a944 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:55.854343 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0c17168e-a332-4e08-8801-fabcbf70a944 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:55.855348 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0c17168e-a332-4e08-8801-fabcbf70a944 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:55.856029 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0c17168e-a332-4e08-8801-fabcbf70a944 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:55.856704 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0c17168e-a332-4e08-8801-fabcbf70a944 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:56.011678 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0c17168e-a332-4e08-8801-fabcbf70a944 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:56.023060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0c17168e-a332-4e08-8801-fabcbf70a944 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e" status: 200 len: 1314 microversion: 2.1 time: 0.179514 Aug 28 10:24:56.024131 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 458/899] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:55 2022] GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:56.787586 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-05a97519-eba2-46dd-946e-4c11f06937ef req-0861488a-8dd1-43ff-bd54-4ad464de408f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78ef862a-38f7-47f6-b474-1b997aa89942", "tag": "b98fe54c-b992-4412-a762-eb682c5e50d5"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:24:56.804737 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-05a97519-eba2-46dd-946e-4c11f06937ef req-0861488a-8dd1-43ff-bd54-4ad464de408f service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:56.805303 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-05a97519-eba2-46dd-946e-4c11f06937ef req-0861488a-8dd1-43ff-bd54-4ad464de408f service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:56.805967 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-05a97519-eba2-46dd-946e-4c11f06937ef req-0861488a-8dd1-43ff-bd54-4ad464de408f service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:56.818419 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-05a97519-eba2-46dd-946e-4c11f06937ef req-0861488a-8dd1-43ff-bd54-4ad464de408f service nova] Creating event network-changed:b98fe54c-b992-4412-a762-eb682c5e50d5 for instance 78ef862a-38f7-47f6-b474-1b997aa89942 on hv-cinder-85200 Aug 28 10:24:56.827770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-05a97519-eba2-46dd-946e-4c11f06937ef req-0861488a-8dd1-43ff-bd54-4ad464de408f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043788 Aug 28 10:24:56.828395 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9a362349-0566-4f58-bf66-f6370c5da986 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:56.829300 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 442/900] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:24:56.831907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9a362349-0566-4f58-bf66-f6370c5da986 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:56.838296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9a362349-0566-4f58-bf66-f6370c5da986 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:56.838877 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9a362349-0566-4f58-bf66-f6370c5da986 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:56.839309 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9a362349-0566-4f58-bf66-f6370c5da986 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:56.840330 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9a362349-0566-4f58-bf66-f6370c5da986 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:56.841304 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9a362349-0566-4f58-bf66-f6370c5da986 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:56.842476 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9a362349-0566-4f58-bf66-f6370c5da986 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:57.032122 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9a362349-0566-4f58-bf66-f6370c5da986 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:57.044339 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-68192831-1f87-420e-b101-4a24469899fd tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:57.045629 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-68192831-1f87-420e-b101-4a24469899fd tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: fc2d1762-d7f5-4ac5-81c5-0888546a210e] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:57.054592 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9a362349-0566-4f58-bf66-f6370c5da986 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:57.057606 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-68192831-1f87-420e-b101-4a24469899fd tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:57.059414 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9a362349-0566-4f58-bf66-f6370c5da986 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:57.060172 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-68192831-1f87-420e-b101-4a24469899fd tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:57.060907 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-68192831-1f87-420e-b101-4a24469899fd tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:57.062351 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9a362349-0566-4f58-bf66-f6370c5da986 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1738 microversion: 2.20 time: 0.240912 Aug 28 10:24:57.063336 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-68192831-1f87-420e-b101-4a24469899fd tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:57.063904 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-68192831-1f87-420e-b101-4a24469899fd tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:57.080883 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 459/901] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:56 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:57.081275 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-68192831-1f87-420e-b101-4a24469899fd tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:57.263964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-68192831-1f87-420e-b101-4a24469899fd tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:57.274564 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-68192831-1f87-420e-b101-4a24469899fd tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e" status: 200 len: 1314 microversion: 2.1 time: 0.234245 Aug 28 10:24:57.280867 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 443/902] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:57 2022] GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:24:57.352783 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-22d450a6-5339-42fd-a769-e312b33b6f4a req-d8563f20-ae44-4476-92bf-7bc6defb1fbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc2d1762-d7f5-4ac5-81c5-0888546a210e", "name": "network-vif-plugged", "status": "completed", "tag": "952c9374-593e-4283-b660-bd891405b43b"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:24:57.369199 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-22d450a6-5339-42fd-a769-e312b33b6f4a req-d8563f20-ae44-4476-92bf-7bc6defb1fbb service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:57.369735 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-22d450a6-5339-42fd-a769-e312b33b6f4a req-d8563f20-ae44-4476-92bf-7bc6defb1fbb service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:57.370313 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-22d450a6-5339-42fd-a769-e312b33b6f4a req-d8563f20-ae44-4476-92bf-7bc6defb1fbb service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:57.388279 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-22d450a6-5339-42fd-a769-e312b33b6f4a req-d8563f20-ae44-4476-92bf-7bc6defb1fbb service nova] Creating event network-vif-plugged:952c9374-593e-4283-b660-bd891405b43b for instance fc2d1762-d7f5-4ac5-81c5-0888546a210e on hv-cinder-85200 Aug 28 10:24:57.394986 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-22d450a6-5339-42fd-a769-e312b33b6f4a req-d8563f20-ae44-4476-92bf-7bc6defb1fbb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045971 Aug 28 10:24:57.396874 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 460/903] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:24:58.087909 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-b2efa463-e205-4e53-8b88-35cb2a0f5b13 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:58.088494 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-b2efa463-e205-4e53-8b88-35cb2a0f5b13 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:58.090081 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=2 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:24:58.090731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=8 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:24:58.096587 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b2efa463-e205-4e53-8b88-35cb2a0f5b13 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:58.097251 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b2efa463-e205-4e53-8b88-35cb2a0f5b13 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:58.097683 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b2efa463-e205-4e53-8b88-35cb2a0f5b13 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:58.098382 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b2efa463-e205-4e53-8b88-35cb2a0f5b13 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:58.098827 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b2efa463-e205-4e53-8b88-35cb2a0f5b13 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:58.099245 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b2efa463-e205-4e53-8b88-35cb2a0f5b13 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:58.275861 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-b2efa463-e205-4e53-8b88-35cb2a0f5b13 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:58.285962 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-b2efa463-e205-4e53-8b88-35cb2a0f5b13 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:58.289833 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-b2efa463-e205-4e53-8b88-35cb2a0f5b13 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:58.291429 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-b2efa463-e205-4e53-8b88-35cb2a0f5b13 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1738 microversion: 2.20 time: 0.207952 Aug 28 10:24:58.292552 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 444/904] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:58 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:58.298407 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=12 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:24:58.303514 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ee119d6f-6040-4d26-b9af-0c3ccbc87518 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:58.304277 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ee119d6f-6040-4d26-b9af-0c3ccbc87518 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: fc2d1762-d7f5-4ac5-81c5-0888546a210e] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:58.321961 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee119d6f-6040-4d26-b9af-0c3ccbc87518 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:58.322542 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee119d6f-6040-4d26-b9af-0c3ccbc87518 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:58.323222 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee119d6f-6040-4d26-b9af-0c3ccbc87518 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:58.323996 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee119d6f-6040-4d26-b9af-0c3ccbc87518 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:58.324668 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee119d6f-6040-4d26-b9af-0c3ccbc87518 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:58.325247 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee119d6f-6040-4d26-b9af-0c3ccbc87518 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:58.523243 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ee119d6f-6040-4d26-b9af-0c3ccbc87518 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:58.532053 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ee119d6f-6040-4d26-b9af-0c3ccbc87518 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e" status: 200 len: 1314 microversion: 2.1 time: 0.240200 Aug 28 10:24:58.544860 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 461/905] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:58 2022] GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:24:59.317669 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-75fda8cf-1824-4918-99d5-62d61113378d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:59.318335 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-75fda8cf-1824-4918-99d5-62d61113378d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:59.326159 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-75fda8cf-1824-4918-99d5-62d61113378d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:59.326574 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-75fda8cf-1824-4918-99d5-62d61113378d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:59.327009 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-75fda8cf-1824-4918-99d5-62d61113378d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:59.327702 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-75fda8cf-1824-4918-99d5-62d61113378d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:59.328178 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-75fda8cf-1824-4918-99d5-62d61113378d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:59.328653 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-75fda8cf-1824-4918-99d5-62d61113378d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:59.460119 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-75fda8cf-1824-4918-99d5-62d61113378d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:59.468745 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-75fda8cf-1824-4918-99d5-62d61113378d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:59.470200 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-75fda8cf-1824-4918-99d5-62d61113378d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:59.471382 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-75fda8cf-1824-4918-99d5-62d61113378d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1738 microversion: 2.20 time: 0.159401 Aug 28 10:24:59.472171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 445/906] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:24:59 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:24:59.554530 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d2adf22d-2906-4a1f-bf12-130da3d8902e tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:24:59.555104 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d2adf22d-2906-4a1f-bf12-130da3d8902e tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: fc2d1762-d7f5-4ac5-81c5-0888546a210e] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:24:59.562334 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2adf22d-2906-4a1f-bf12-130da3d8902e tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:59.562915 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2adf22d-2906-4a1f-bf12-130da3d8902e tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:59.563409 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2adf22d-2906-4a1f-bf12-130da3d8902e tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:59.564172 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2adf22d-2906-4a1f-bf12-130da3d8902e tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:24:59.564834 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2adf22d-2906-4a1f-bf12-130da3d8902e tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:24:59.565301 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2adf22d-2906-4a1f-bf12-130da3d8902e tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:24:59.700116 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d2adf22d-2906-4a1f-bf12-130da3d8902e tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:24:59.708245 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d2adf22d-2906-4a1f-bf12-130da3d8902e tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e" status: 200 len: 1498 microversion: 2.1 time: 0.158136 Aug 28 10:24:59.708949 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 462/907] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:24:59 2022] GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e => generated 1498 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:00.299840 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c14ae4f3-fa63-4594-8e38-2d8adab7659d tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:00.300325 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c14ae4f3-fa63-4594-8e38-2d8adab7659d tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: fc2d1762-d7f5-4ac5-81c5-0888546a210e] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:00.306932 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c14ae4f3-fa63-4594-8e38-2d8adab7659d tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:00.307468 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c14ae4f3-fa63-4594-8e38-2d8adab7659d tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:00.307973 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c14ae4f3-fa63-4594-8e38-2d8adab7659d tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:00.308718 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c14ae4f3-fa63-4594-8e38-2d8adab7659d tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:00.309158 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c14ae4f3-fa63-4594-8e38-2d8adab7659d tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:00.309565 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c14ae4f3-fa63-4594-8e38-2d8adab7659d tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:00.493059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c14ae4f3-fa63-4594-8e38-2d8adab7659d tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: fc2d1762-d7f5-4ac5-81c5-0888546a210e] Going to try to terminate instance {{(pid=120664) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 28 10:25:00.494966 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3f371c20-1d4b-438e-aa7e-6f198e88fddc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:00.495574 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3f371c20-1d4b-438e-aa7e-6f198e88fddc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:00.501654 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3f371c20-1d4b-438e-aa7e-6f198e88fddc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:00.502130 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3f371c20-1d4b-438e-aa7e-6f198e88fddc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:00.502552 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3f371c20-1d4b-438e-aa7e-6f198e88fddc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:00.503228 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3f371c20-1d4b-438e-aa7e-6f198e88fddc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:00.503663 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3f371c20-1d4b-438e-aa7e-6f198e88fddc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:00.504074 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3f371c20-1d4b-438e-aa7e-6f198e88fddc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:00.580283 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c14ae4f3-fa63-4594-8e38-2d8adab7659d tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e" status: 204 len: 0 microversion: 2.1 time: 0.284007 Aug 28 10:25:00.584909 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 446/908] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:25:00 2022] DELETE /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 28 10:25:00.590876 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f6560a7f-bdff-4f0f-91d5-d733fd8eb84d tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:00.591664 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f6560a7f-bdff-4f0f-91d5-d733fd8eb84d tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: fc2d1762-d7f5-4ac5-81c5-0888546a210e] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:00.597613 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f6560a7f-bdff-4f0f-91d5-d733fd8eb84d tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:00.598096 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f6560a7f-bdff-4f0f-91d5-d733fd8eb84d tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:00.598529 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f6560a7f-bdff-4f0f-91d5-d733fd8eb84d tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:00.599225 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f6560a7f-bdff-4f0f-91d5-d733fd8eb84d tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:00.599670 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f6560a7f-bdff-4f0f-91d5-d733fd8eb84d tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:00.600085 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f6560a7f-bdff-4f0f-91d5-d733fd8eb84d tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:00.686446 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3f371c20-1d4b-438e-aa7e-6f198e88fddc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:00.694966 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3f371c20-1d4b-438e-aa7e-6f198e88fddc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:00.696411 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3f371c20-1d4b-438e-aa7e-6f198e88fddc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:00.697594 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3f371c20-1d4b-438e-aa7e-6f198e88fddc tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1720 microversion: 2.20 time: 0.206543 Aug 28 10:25:00.698157 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 463/909] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:00 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1720 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:00.755525 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f6560a7f-bdff-4f0f-91d5-d733fd8eb84d tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:00.764544 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f6560a7f-bdff-4f0f-91d5-d733fd8eb84d tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e" status: 200 len: 1504 microversion: 2.1 time: 0.177713 Aug 28 10:25:00.765241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 447/910] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:00 2022] GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e => generated 1504 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:25:01.721890 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-26bd7a84-ab60-40dc-a5e5-337fa4df0237 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:01.722487 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-26bd7a84-ab60-40dc-a5e5-337fa4df0237 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:01.729088 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-26bd7a84-ab60-40dc-a5e5-337fa4df0237 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:01.729593 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-26bd7a84-ab60-40dc-a5e5-337fa4df0237 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:01.730034 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-26bd7a84-ab60-40dc-a5e5-337fa4df0237 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:01.730717 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-26bd7a84-ab60-40dc-a5e5-337fa4df0237 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:01.731157 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-26bd7a84-ab60-40dc-a5e5-337fa4df0237 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:01.731596 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-26bd7a84-ab60-40dc-a5e5-337fa4df0237 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:01.785933 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-1a33b933-4ac4-4f23-aeba-c8ad144f1423 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:01.786490 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-1a33b933-4ac4-4f23-aeba-c8ad144f1423 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: fc2d1762-d7f5-4ac5-81c5-0888546a210e] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:01.793323 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1a33b933-4ac4-4f23-aeba-c8ad144f1423 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:01.794150 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1a33b933-4ac4-4f23-aeba-c8ad144f1423 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:01.794599 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1a33b933-4ac4-4f23-aeba-c8ad144f1423 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:01.795295 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1a33b933-4ac4-4f23-aeba-c8ad144f1423 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:01.795740 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1a33b933-4ac4-4f23-aeba-c8ad144f1423 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:01.796160 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1a33b933-4ac4-4f23-aeba-c8ad144f1423 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:01.908015 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-26bd7a84-ab60-40dc-a5e5-337fa4df0237 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:01.916872 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-26bd7a84-ab60-40dc-a5e5-337fa4df0237 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:01.918314 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-26bd7a84-ab60-40dc-a5e5-337fa4df0237 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:01.919812 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-26bd7a84-ab60-40dc-a5e5-337fa4df0237 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1720 microversion: 2.20 time: 0.202029 Aug 28 10:25:01.920357 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 464/911] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:01 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1720 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:01.961854 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-1a33b933-4ac4-4f23-aeba-c8ad144f1423 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:01.970531 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-1a33b933-4ac4-4f23-aeba-c8ad144f1423 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e" status: 200 len: 1504 microversion: 2.1 time: 0.188658 Aug 28 10:25:01.971105 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 448/912] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:01 2022] GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e => generated 1504 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:25:02.872954 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-bddf6377-f0f9-4622-92e1-0d7a4bf93266 req-0582099f-168f-48dd-9c3e-0c95c478ccbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6960433f-4e91-4c5b-9c8e-50645b6e13e7", "name": "network-vif-unplugged", "status": "completed", "tag": "609522cc-a982-46e3-bc01-474519fee148"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:25:02.885129 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:02.899084 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-bddf6377-f0f9-4622-92e1-0d7a4bf93266 req-0582099f-168f-48dd-9c3e-0c95c478ccbb service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:02.899463 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-bddf6377-f0f9-4622-92e1-0d7a4bf93266 req-0582099f-168f-48dd-9c3e-0c95c478ccbb service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:02.900026 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-bddf6377-f0f9-4622-92e1-0d7a4bf93266 req-0582099f-168f-48dd-9c3e-0c95c478ccbb service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:02.925815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-bddf6377-f0f9-4622-92e1-0d7a4bf93266 req-0582099f-168f-48dd-9c3e-0c95c478ccbb service nova] Creating event network-vif-unplugged:609522cc-a982-46e3-bc01-474519fee148 for instance 6960433f-4e91-4c5b-9c8e-50645b6e13e7 on hv-cinder-85200 Aug 28 10:25:02.934534 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-bddf6377-f0f9-4622-92e1-0d7a4bf93266 req-0582099f-168f-48dd-9c3e-0c95c478ccbb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065482 Aug 28 10:25:02.935300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 465/913] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:25:02.942988 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-07292a3a-f74f-4d37-9d09-c9997ff6f1bd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:02.943597 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-07292a3a-f74f-4d37-9d09-c9997ff6f1bd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:02.950459 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-07292a3a-f74f-4d37-9d09-c9997ff6f1bd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:02.951017 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-07292a3a-f74f-4d37-9d09-c9997ff6f1bd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:02.951442 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-07292a3a-f74f-4d37-9d09-c9997ff6f1bd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:02.952712 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-07292a3a-f74f-4d37-9d09-c9997ff6f1bd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:02.953160 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-07292a3a-f74f-4d37-9d09-c9997ff6f1bd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:02.953804 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-07292a3a-f74f-4d37-9d09-c9997ff6f1bd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:02.996120 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6bf9aa36-fa72-44b7-8b03-da1cc02e18f9 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:02.997015 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6bf9aa36-fa72-44b7-8b03-da1cc02e18f9 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: fc2d1762-d7f5-4ac5-81c5-0888546a210e] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:03.003912 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6bf9aa36-fa72-44b7-8b03-da1cc02e18f9 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:03.004398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6bf9aa36-fa72-44b7-8b03-da1cc02e18f9 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:03.004883 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6bf9aa36-fa72-44b7-8b03-da1cc02e18f9 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:03.005658 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6bf9aa36-fa72-44b7-8b03-da1cc02e18f9 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:03.006112 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6bf9aa36-fa72-44b7-8b03-da1cc02e18f9 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:03.006531 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6bf9aa36-fa72-44b7-8b03-da1cc02e18f9 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:03.137502 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-07292a3a-f74f-4d37-9d09-c9997ff6f1bd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:03.146854 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-07292a3a-f74f-4d37-9d09-c9997ff6f1bd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:03.148636 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-07292a3a-f74f-4d37-9d09-c9997ff6f1bd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:03.150070 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-07292a3a-f74f-4d37-9d09-c9997ff6f1bd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1720 microversion: 2.20 time: 0.210854 Aug 28 10:25:03.160639 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 449/914] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:02 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1720 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:03.166740 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6bf9aa36-fa72-44b7-8b03-da1cc02e18f9 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:03.175739 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6bf9aa36-fa72-44b7-8b03-da1cc02e18f9 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e" status: 200 len: 1504 microversion: 2.1 time: 0.184098 Aug 28 10:25:03.176323 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 466/915] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:02 2022] GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e => generated 1504 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:25:03.306721 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-8cef973f-d3aa-4752-875f-4631d7632cf0 req-34af3e81-9f35-4a91-bc36-edec0983dec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc2d1762-d7f5-4ac5-81c5-0888546a210e", "name": "network-vif-deleted", "tag": "952c9374-593e-4283-b660-bd891405b43b"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:25:03.316775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-8cef973f-d3aa-4752-875f-4631d7632cf0 req-34af3e81-9f35-4a91-bc36-edec0983dec8 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:03.317250 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-8cef973f-d3aa-4752-875f-4631d7632cf0 req-34af3e81-9f35-4a91-bc36-edec0983dec8 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:03.317674 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-8cef973f-d3aa-4752-875f-4631d7632cf0 req-34af3e81-9f35-4a91-bc36-edec0983dec8 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:03.329312 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-8cef973f-d3aa-4752-875f-4631d7632cf0 req-34af3e81-9f35-4a91-bc36-edec0983dec8 service nova] Creating event network-vif-deleted:952c9374-593e-4283-b660-bd891405b43b for instance fc2d1762-d7f5-4ac5-81c5-0888546a210e on hv-cinder-85200 Aug 28 10:25:03.334243 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-8cef973f-d3aa-4752-875f-4631d7632cf0 req-34af3e81-9f35-4a91-bc36-edec0983dec8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031373 Aug 28 10:25:03.335102 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 450/916] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:25:04.178713 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ce88c3db-01b6-48e7-9aa9-027c3349275c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:04.179686 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ce88c3db-01b6-48e7-9aa9-027c3349275c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:04.188128 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ce88c3db-01b6-48e7-9aa9-027c3349275c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:04.188628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ce88c3db-01b6-48e7-9aa9-027c3349275c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:04.189080 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ce88c3db-01b6-48e7-9aa9-027c3349275c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:04.189758 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ce88c3db-01b6-48e7-9aa9-027c3349275c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:04.190178 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ce88c3db-01b6-48e7-9aa9-027c3349275c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:04.190610 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ce88c3db-01b6-48e7-9aa9-027c3349275c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:04.199121 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-04127433-ff28-4829-a63d-dd14659b71e5 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:04.199817 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-04127433-ff28-4829-a63d-dd14659b71e5 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: fc2d1762-d7f5-4ac5-81c5-0888546a210e] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:04.201834 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:04.207258 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-04127433-ff28-4829-a63d-dd14659b71e5 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:04.207739 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-04127433-ff28-4829-a63d-dd14659b71e5 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:04.208163 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-04127433-ff28-4829-a63d-dd14659b71e5 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:04.208878 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-04127433-ff28-4829-a63d-dd14659b71e5 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:04.209319 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-04127433-ff28-4829-a63d-dd14659b71e5 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:04.209730 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-04127433-ff28-4829-a63d-dd14659b71e5 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:04.291560 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-04127433-ff28-4829-a63d-dd14659b71e5 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:04.300000 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-04127433-ff28-4829-a63d-dd14659b71e5 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e" status: 200 len: 1462 microversion: 2.1 time: 0.105547 Aug 28 10:25:04.300569 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 451/917] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:04 2022] GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e => generated 1462 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:04.346025 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ce88c3db-01b6-48e7-9aa9-027c3349275c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:04.354954 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ce88c3db-01b6-48e7-9aa9-027c3349275c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:04.356422 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ce88c3db-01b6-48e7-9aa9-027c3349275c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:04.357605 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ce88c3db-01b6-48e7-9aa9-027c3349275c tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1720 microversion: 2.20 time: 0.187109 Aug 28 10:25:04.358173 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 467/918] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:04 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1720 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:05.321338 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-34bd319b-a0ba-4877-b686-5c5c088f25df tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:05.322048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-34bd319b-a0ba-4877-b686-5c5c088f25df tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: fc2d1762-d7f5-4ac5-81c5-0888546a210e] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:05.329132 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-34bd319b-a0ba-4877-b686-5c5c088f25df tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:05.329609 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-34bd319b-a0ba-4877-b686-5c5c088f25df tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:05.330035 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-34bd319b-a0ba-4877-b686-5c5c088f25df tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:05.330715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-34bd319b-a0ba-4877-b686-5c5c088f25df tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:05.331156 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-34bd319b-a0ba-4877-b686-5c5c088f25df tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:05.331569 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-34bd319b-a0ba-4877-b686-5c5c088f25df tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:05.363965 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-34bd319b-a0ba-4877-b686-5c5c088f25df tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:05.364427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-34bd319b-a0ba-4877-b686-5c5c088f25df tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:05.364878 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-34bd319b-a0ba-4877-b686-5c5c088f25df tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:05.365301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.objects.instance [None req-34bd319b-a0ba-4877-b686-5c5c088f25df tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lazy-loading 'fault' on Instance uuid fc2d1762-d7f5-4ac5-81c5-0888546a210e {{(pid=120664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:25:05.385092 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0e299606-20dd-46e7-9fe0-883391429dd1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:05.385749 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0e299606-20dd-46e7-9fe0-883391429dd1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:05.392740 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e299606-20dd-46e7-9fe0-883391429dd1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:05.393230 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e299606-20dd-46e7-9fe0-883391429dd1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:05.393648 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e299606-20dd-46e7-9fe0-883391429dd1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:05.394342 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e299606-20dd-46e7-9fe0-883391429dd1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:05.394789 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e299606-20dd-46e7-9fe0-883391429dd1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:05.395208 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e299606-20dd-46e7-9fe0-883391429dd1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:05.405495 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-34bd319b-a0ba-4877-b686-5c5c088f25df tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:05.413427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-34bd319b-a0ba-4877-b686-5c5c088f25df tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e" status: 200 len: 1304 microversion: 2.1 time: 0.096094 Aug 28 10:25:05.414079 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 452/919] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:05 2022] GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:05.527969 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0e299606-20dd-46e7-9fe0-883391429dd1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:05.536314 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0e299606-20dd-46e7-9fe0-883391429dd1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:05.537776 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0e299606-20dd-46e7-9fe0-883391429dd1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:05.538926 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0e299606-20dd-46e7-9fe0-883391429dd1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1723 microversion: 2.20 time: 0.157790 Aug 28 10:25:05.539463 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 468/920] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:05 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:05.563507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-ccacfc9e-4d63-46d1-83cb-5ca8453d55fd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2613b51f-bb88-436d-bdfd-d48c726e84b1"}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:25:05.566322 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-ccacfc9e-4d63-46d1-83cb-5ca8453d55fd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:05.573454 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ccacfc9e-4d63-46d1-83cb-5ca8453d55fd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:05.574157 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ccacfc9e-4d63-46d1-83cb-5ca8453d55fd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:05.574896 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ccacfc9e-4d63-46d1-83cb-5ca8453d55fd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:05.575591 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ccacfc9e-4d63-46d1-83cb-5ca8453d55fd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:05.576027 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ccacfc9e-4d63-46d1-83cb-5ca8453d55fd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:05.576572 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ccacfc9e-4d63-46d1-83cb-5ca8453d55fd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:05.860746 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:05.879470 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-ccacfc9e-4d63-46d1-83cb-5ca8453d55fd tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "POST /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.321415 Aug 28 10:25:05.880038 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 453/921] 10.222.0.40 () {62 vars in 1364 bytes} [Sun Aug 28 10:25:05 2022] POST /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7/os-volume_attachments => generated 188 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 28 10:25:06.009906 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-eba25b99-5b46-4cac-9fe8-aba4a8fbce3e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:06.010530 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-eba25b99-5b46-4cac-9fe8-aba4a8fbce3e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:06.017419 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eba25b99-5b46-4cac-9fe8-aba4a8fbce3e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:06.017894 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eba25b99-5b46-4cac-9fe8-aba4a8fbce3e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:06.018321 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eba25b99-5b46-4cac-9fe8-aba4a8fbce3e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:06.019016 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eba25b99-5b46-4cac-9fe8-aba4a8fbce3e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:06.019600 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eba25b99-5b46-4cac-9fe8-aba4a8fbce3e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:06.020023 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eba25b99-5b46-4cac-9fe8-aba4a8fbce3e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:06.268588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:06.285698 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-eba25b99-5b46-4cac-9fe8-aba4a8fbce3e tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7/os-volume_attachments/2613b51f-bb88-436d-bdfd-d48c726e84b1" status: 202 len: 0 microversion: 2.20 time: 0.279891 Aug 28 10:25:06.286447 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 469/922] 10.222.0.40 () {60 vars in 1457 bytes} [Sun Aug 28 10:25:06 2022] DELETE /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7/os-volume_attachments/2613b51f-bb88-436d-bdfd-d48c726e84b1 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 28 10:25:06.345862 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e1e198c7-977d-417b-a799-11f356ace29f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:25:06.346449 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e1e198c7-977d-417b-a799-11f356ace29f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:06.353378 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e1e198c7-977d-417b-a799-11f356ace29f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:06.353857 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e1e198c7-977d-417b-a799-11f356ace29f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:06.354281 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e1e198c7-977d-417b-a799-11f356ace29f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:06.354964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e1e198c7-977d-417b-a799-11f356ace29f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:06.355379 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e1e198c7-977d-417b-a799-11f356ace29f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:06.355830 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e1e198c7-977d-417b-a799-11f356ace29f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:06.401791 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e1e198c7-977d-417b-a799-11f356ace29f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120664) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 28 10:25:06.435115 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a4e70cf9-3079-42f1-8783-be11e49a56f1 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:06.435718 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a4e70cf9-3079-42f1-8783-be11e49a56f1 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: fc2d1762-d7f5-4ac5-81c5-0888546a210e] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:06.443264 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4e70cf9-3079-42f1-8783-be11e49a56f1 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:06.443743 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4e70cf9-3079-42f1-8783-be11e49a56f1 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:06.444173 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4e70cf9-3079-42f1-8783-be11e49a56f1 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:06.444877 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4e70cf9-3079-42f1-8783-be11e49a56f1 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:06.445324 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4e70cf9-3079-42f1-8783-be11e49a56f1 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:06.445742 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4e70cf9-3079-42f1-8783-be11e49a56f1 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:06.459724 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-a4e70cf9-3079-42f1-8783-be11e49a56f1 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] HTTP exception thrown: Instance fc2d1762-d7f5-4ac5-81c5-0888546a210e could not be found. Aug 28 10:25:06.461710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a4e70cf9-3079-42f1-8783-be11e49a56f1 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Request method failure captured: Aug 28 10:25:06.461710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e HTTP/1.1 Aug 28 10:25:06.461710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:25:06.461710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:25:06.461710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:25:06.461710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:25:06.461710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:25:06.461710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:25:06.461710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:25:06.461710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:25:06.461710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0JtOm3J8szJqkMErNl3K4IokzWiGBnloYFm9ntv1bqyVXi3fd-ZyjoXNcGUgR9ufvkoVZa_esiEyLy_nCrarf0rp-_uQ4qcfsTOtX7E-lQDlxLMxlmaa4dy7hY5AOIoG1IVq5cADPMgDLHUBY27R7U8Zyykq0V0SUjMCqx2nhJIxww Aug 28 10:25:06.461710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:25:06.461710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:25:06.461710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:25:06.461710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:25:06.461710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:25:06.461710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:25:06.461710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 75e24ec2c109424ab964b4d441db44e7 Aug 28 10:25:06.461710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesActionsTest-890997455 Aug 28 10:25:06.461710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:25:06.461710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:25:06.463687 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_75e24ec2c109424ab964b4d441db44e7", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/75e24ec2c109424ab964b4d441db44e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/75e24ec2c109424ab964b4d441db44e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/75e24ec2c109424ab964b4d441db44e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:25:06.463687 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesActionsTest-890997455 Aug 28 10:25:06.463687 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 75e24ec2c109424ab964b4d441db44e7 Aug 28 10:25:06.463687 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesActionsTest-890997455 Aug 28 10:25:06.463687 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesActionsTest-890997455-project Aug 28 10:25:06.463687 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:25:06.463687 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:25:06.463687 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: b661e219b74f436bb668806a547f4778 Aug 28 10:25:06.463687 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesActionsTest-890997455-project Aug 28 10:25:06.463687 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: > Aug 28 10:25:06.463687 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Instance fc2d1762-d7f5-4ac5-81c5-0888546a210e could not be found. Aug 28 10:25:06.463687 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'id': 'fc2d1762-d7f5-4ac5-81c5-0888546a210e'} Aug 28 10:25:06.464815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:25:06.464815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:25:06.464815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:25:06.464815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:25:06.464815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:25:06.464815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:25:06.464815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:25:06.464815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:25:06.464815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:25:06.464815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:25:06.464815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc2d1762-d7f5-4ac5-81c5-0888546a210e could not be found. Aug 28 10:25:06.464815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:25:06.464815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:25:06.464815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:25:06.464815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:25:06.464815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:25:06.464815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:25:06.464815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:25:06.464815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:25:06.464815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:25:06.466381 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:25:06.466381 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:25:06.466381 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:25:06.466381 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:25:06.466381 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:25:06.466381 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:25:06.466381 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:25:06.466381 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc2d1762-d7f5-4ac5-81c5-0888546a210e could not be found. Aug 28 10:25:06.466381 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:25:06.466381 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:25:06.466381 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:25:06.466381 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:25:06.466381 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:25:06.466381 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:25:06.466381 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:25:06.466381 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:25:06.466381 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc2d1762-d7f5-4ac5-81c5-0888546a210e could not be found. Aug 28 10:25:06.466381 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:25:06.467865 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a4e70cf9-3079-42f1-8783-be11e49a56f1 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Returning 404 to user: Instance fc2d1762-d7f5-4ac5-81c5-0888546a210e could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:25:06.467865 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a4e70cf9-3079-42f1-8783-be11e49a56f1 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e" status: 404 len: 111 microversion: 2.1 time: 0.032105 Aug 28 10:25:06.467865 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 470/923] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:06 2022] GET /compute/v2.1/servers/fc2d1762-d7f5-4ac5-81c5-0888546a210e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 28 10:25:06.483001 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-e1e198c7-977d-417b-a799-11f356ace29f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "POST /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7/action" status: 202 len: 0 microversion: 2.20 time: 0.141034 Aug 28 10:25:06.483734 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 454/924] 10.222.0.40 () {62 vars in 1319 bytes} [Sun Aug 28 10:25:06 2022] POST /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 28 10:25:06.491829 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0a171cf9-c9f9-4fb0-afc8-af50a76c70c4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:06.492432 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0a171cf9-c9f9-4fb0-afc8-af50a76c70c4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:06.499083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0a171cf9-c9f9-4fb0-afc8-af50a76c70c4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:06.499651 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0a171cf9-c9f9-4fb0-afc8-af50a76c70c4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:06.500260 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0a171cf9-c9f9-4fb0-afc8-af50a76c70c4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:06.501120 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0a171cf9-c9f9-4fb0-afc8-af50a76c70c4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:06.501569 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0a171cf9-c9f9-4fb0-afc8-af50a76c70c4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:06.501985 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0a171cf9-c9f9-4fb0-afc8-af50a76c70c4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:06.519649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-fed7fa34-b55e-47b7-887e-4bbc97e1d421 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1073579023", "imageRef": "2780c39b-8bd3-4e73-9669-2b2e29474f3e", "flavorRef": "452", "networks": [{"uuid": "3c7bda95-5a0f-4fa1-b22e-fa05711e7756"}]}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:25:06.576605 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.network.neutron [None req-fed7fa34-b55e-47b7-887e-4bbc97e1d421 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] validate_networks() for [('3c7bda95-5a0f-4fa1-b22e-fa05711e7756', None, None, None, None, None)] {{(pid=120664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 28 10:25:06.724225 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0a171cf9-c9f9-4fb0-afc8-af50a76c70c4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:06.734173 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0a171cf9-c9f9-4fb0-afc8-af50a76c70c4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:06.735810 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0a171cf9-c9f9-4fb0-afc8-af50a76c70c4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:06.736985 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0a171cf9-c9f9-4fb0-afc8-af50a76c70c4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1671 microversion: 2.20 time: 0.249134 Aug 28 10:25:06.737542 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 471/925] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:06 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1671 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:06.984323 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-fed7fa34-b55e-47b7-887e-4bbc97e1d421 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Flavor limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 28 10:25:06.984875 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-fed7fa34-b55e-47b7-887e-4bbc97e1d421 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Image limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 28 10:25:06.985437 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-fed7fa34-b55e-47b7-887e-4bbc97e1d421 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Flavor pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 28 10:25:06.985905 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-fed7fa34-b55e-47b7-887e-4bbc97e1d421 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Image pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 28 10:25:06.986376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-fed7fa34-b55e-47b7-887e-4bbc97e1d421 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 28 10:25:06.995879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fed7fa34-b55e-47b7-887e-4bbc97e1d421 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:06.996362 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fed7fa34-b55e-47b7-887e-4bbc97e1d421 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:06.996856 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fed7fa34-b55e-47b7-887e-4bbc97e1d421 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:06.997586 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fed7fa34-b55e-47b7-887e-4bbc97e1d421 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:06.998036 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fed7fa34-b55e-47b7-887e-4bbc97e1d421 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:06.998458 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fed7fa34-b55e-47b7-887e-4bbc97e1d421 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:07.015371 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-fed7fa34-b55e-47b7-887e-4bbc97e1d421 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Getting quotas for project 75e24ec2c109424ab964b4d441db44e7. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:25:07.019365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-fed7fa34-b55e-47b7-887e-4bbc97e1d421 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Getting quotas for user b661e219b74f436bb668806a547f4778 and project 75e24ec2c109424ab964b4d441db44e7. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:25:07.030754 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-fed7fa34-b55e-47b7-887e-4bbc97e1d421 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Going to run 1 instances... {{(pid=120664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 28 10:25:07.033163 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-fed7fa34-b55e-47b7-887e-4bbc97e1d421 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2780c39b-8bd3-4e73-9669-2b2e29474f3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 28 10:25:07.085644 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-fed7fa34-b55e-47b7-887e-4bbc97e1d421 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569765 Aug 28 10:25:07.086207 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 455/926] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Aug 28 10:25:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 28 10:25:07.097402 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c5021178-33ac-4a91-b51c-d32a18a988fe tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:07.098001 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c5021178-33ac-4a91-b51c-d32a18a988fe tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:07.166710 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c5021178-33ac-4a91-b51c-d32a18a988fe tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:07.177698 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c5021178-33ac-4a91-b51c-d32a18a988fe tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1214 microversion: 2.1 time: 0.083702 Aug 28 10:25:07.178382 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 472/927] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:07 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:07.760784 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f8ec1cab-ef0f-4817-b991-d11406bbe364 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:07.761427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f8ec1cab-ef0f-4817-b991-d11406bbe364 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:07.768941 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f8ec1cab-ef0f-4817-b991-d11406bbe364 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:07.769572 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f8ec1cab-ef0f-4817-b991-d11406bbe364 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:07.769994 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f8ec1cab-ef0f-4817-b991-d11406bbe364 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:07.771036 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f8ec1cab-ef0f-4817-b991-d11406bbe364 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:07.771674 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f8ec1cab-ef0f-4817-b991-d11406bbe364 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:07.772112 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f8ec1cab-ef0f-4817-b991-d11406bbe364 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:07.915183 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f8ec1cab-ef0f-4817-b991-d11406bbe364 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:07.924794 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f8ec1cab-ef0f-4817-b991-d11406bbe364 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:07.926300 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f8ec1cab-ef0f-4817-b991-d11406bbe364 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:07.927510 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f8ec1cab-ef0f-4817-b991-d11406bbe364 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1673 microversion: 2.20 time: 0.171412 Aug 28 10:25:07.928042 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 456/928] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:07 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:08.201605 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-08df336d-74c6-452d-abae-f88f0dc14055 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:08.202174 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-08df336d-74c6-452d-abae-f88f0dc14055 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:08.209227 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08df336d-74c6-452d-abae-f88f0dc14055 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:08.209712 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08df336d-74c6-452d-abae-f88f0dc14055 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:08.210142 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08df336d-74c6-452d-abae-f88f0dc14055 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:08.210830 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08df336d-74c6-452d-abae-f88f0dc14055 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:08.211489 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08df336d-74c6-452d-abae-f88f0dc14055 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:08.211914 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08df336d-74c6-452d-abae-f88f0dc14055 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:08.274524 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-08df336d-74c6-452d-abae-f88f0dc14055 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:08.286026 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-08df336d-74c6-452d-abae-f88f0dc14055 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1266 microversion: 2.1 time: 0.088511 Aug 28 10:25:08.286720 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 473/929] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:08 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:08.952421 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-7c3c3023-34ec-4269-9a36-b68ac4c3d72d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:08.953041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-7c3c3023-34ec-4269-9a36-b68ac4c3d72d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:08.959832 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7c3c3023-34ec-4269-9a36-b68ac4c3d72d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:08.960307 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7c3c3023-34ec-4269-9a36-b68ac4c3d72d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:08.960770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7c3c3023-34ec-4269-9a36-b68ac4c3d72d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:08.961458 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7c3c3023-34ec-4269-9a36-b68ac4c3d72d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:08.961895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7c3c3023-34ec-4269-9a36-b68ac4c3d72d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:08.962310 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7c3c3023-34ec-4269-9a36-b68ac4c3d72d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:09.094360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7c3c3023-34ec-4269-9a36-b68ac4c3d72d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:09.102847 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7c3c3023-34ec-4269-9a36-b68ac4c3d72d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:09.104252 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7c3c3023-34ec-4269-9a36-b68ac4c3d72d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:09.105417 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-7c3c3023-34ec-4269-9a36-b68ac4c3d72d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1729 microversion: 2.20 time: 0.157481 Aug 28 10:25:09.105979 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 457/930] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:08 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:09.310590 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cbb96081-eaea-40cb-985b-3b7644a5665b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:09.311180 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cbb96081-eaea-40cb-985b-3b7644a5665b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:09.318060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cbb96081-eaea-40cb-985b-3b7644a5665b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:09.318545 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cbb96081-eaea-40cb-985b-3b7644a5665b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:09.318976 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cbb96081-eaea-40cb-985b-3b7644a5665b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:09.319670 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cbb96081-eaea-40cb-985b-3b7644a5665b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:09.320091 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cbb96081-eaea-40cb-985b-3b7644a5665b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:09.320542 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cbb96081-eaea-40cb-985b-3b7644a5665b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:09.382906 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cbb96081-eaea-40cb-985b-3b7644a5665b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:09.390752 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cbb96081-eaea-40cb-985b-3b7644a5665b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1272 microversion: 2.1 time: 0.084359 Aug 28 10:25:09.391326 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 474/931] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:09 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1272 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:10.129471 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-d68def18-05b5-4aa4-b782-25251f5cb3b3 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:10.131114 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-d68def18-05b5-4aa4-b782-25251f5cb3b3 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:10.139206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d68def18-05b5-4aa4-b782-25251f5cb3b3 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:10.139985 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d68def18-05b5-4aa4-b782-25251f5cb3b3 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:10.141615 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d68def18-05b5-4aa4-b782-25251f5cb3b3 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:10.142817 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d68def18-05b5-4aa4-b782-25251f5cb3b3 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:10.143473 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d68def18-05b5-4aa4-b782-25251f5cb3b3 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:10.144078 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d68def18-05b5-4aa4-b782-25251f5cb3b3 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:10.332782 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d68def18-05b5-4aa4-b782-25251f5cb3b3 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:10.350070 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d68def18-05b5-4aa4-b782-25251f5cb3b3 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:10.351717 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d68def18-05b5-4aa4-b782-25251f5cb3b3 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:10.353444 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-d68def18-05b5-4aa4-b782-25251f5cb3b3 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1729 microversion: 2.20 time: 0.228662 Aug 28 10:25:10.354662 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 458/932] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:10 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1729 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:10.411836 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f6bef8b9-eeb4-4aea-b70c-d1c37e7be93f tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:10.413367 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f6bef8b9-eeb4-4aea-b70c-d1c37e7be93f tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:10.420672 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f6bef8b9-eeb4-4aea-b70c-d1c37e7be93f tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:10.421410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f6bef8b9-eeb4-4aea-b70c-d1c37e7be93f tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:10.421995 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f6bef8b9-eeb4-4aea-b70c-d1c37e7be93f tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:10.422996 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f6bef8b9-eeb4-4aea-b70c-d1c37e7be93f tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:10.423654 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f6bef8b9-eeb4-4aea-b70c-d1c37e7be93f tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:10.424212 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f6bef8b9-eeb4-4aea-b70c-d1c37e7be93f tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:10.625768 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f6bef8b9-eeb4-4aea-b70c-d1c37e7be93f tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:10.634791 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f6bef8b9-eeb4-4aea-b70c-d1c37e7be93f tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1314 microversion: 2.1 time: 0.226871 Aug 28 10:25:10.654673 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 475/933] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:10 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:10.751539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-20203d6a-d342-42e0-879c-996947823439 req-9c796d71-e84e-4917-aa6a-93f38467609d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f58d4ae7-1483-4df4-a66a-456ba4329c37", "tag": "3b08f2ab-8dd8-4b4e-90f9-7419bf78c3b3"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:25:10.761536 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-20203d6a-d342-42e0-879c-996947823439 req-9c796d71-e84e-4917-aa6a-93f38467609d service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:10.761999 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-20203d6a-d342-42e0-879c-996947823439 req-9c796d71-e84e-4917-aa6a-93f38467609d service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:10.762425 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-20203d6a-d342-42e0-879c-996947823439 req-9c796d71-e84e-4917-aa6a-93f38467609d service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:10.774962 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-20203d6a-d342-42e0-879c-996947823439 req-9c796d71-e84e-4917-aa6a-93f38467609d service nova] Creating event network-changed:3b08f2ab-8dd8-4b4e-90f9-7419bf78c3b3 for instance f58d4ae7-1483-4df4-a66a-456ba4329c37 on hv-cinder-85200 Aug 28 10:25:10.780169 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-20203d6a-d342-42e0-879c-996947823439 req-9c796d71-e84e-4917-aa6a-93f38467609d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033329 Aug 28 10:25:10.780991 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 459/934] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:25:11.377623 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-daadd471-238d-4cab-aacd-0688c1412187 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:11.378221 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-daadd471-238d-4cab-aacd-0688c1412187 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:11.384644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-daadd471-238d-4cab-aacd-0688c1412187 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:11.385138 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-daadd471-238d-4cab-aacd-0688c1412187 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:11.385563 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-daadd471-238d-4cab-aacd-0688c1412187 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:11.386257 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-daadd471-238d-4cab-aacd-0688c1412187 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:11.386703 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-daadd471-238d-4cab-aacd-0688c1412187 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:11.387117 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-daadd471-238d-4cab-aacd-0688c1412187 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:11.531346 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-daadd471-238d-4cab-aacd-0688c1412187 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:11.540638 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-daadd471-238d-4cab-aacd-0688c1412187 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:11.542083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-daadd471-238d-4cab-aacd-0688c1412187 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:11.543251 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-daadd471-238d-4cab-aacd-0688c1412187 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1729 microversion: 2.20 time: 0.169781 Aug 28 10:25:11.544204 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 476/935] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:11 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:11.656849 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-583c6d40-bed6-47dc-ad79-f3c053b6e89b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:11.657526 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-583c6d40-bed6-47dc-ad79-f3c053b6e89b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:11.664116 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-583c6d40-bed6-47dc-ad79-f3c053b6e89b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:11.664706 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-583c6d40-bed6-47dc-ad79-f3c053b6e89b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:11.665218 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-583c6d40-bed6-47dc-ad79-f3c053b6e89b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:11.665915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-583c6d40-bed6-47dc-ad79-f3c053b6e89b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:11.666360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-583c6d40-bed6-47dc-ad79-f3c053b6e89b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:11.666918 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-583c6d40-bed6-47dc-ad79-f3c053b6e89b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:11.820943 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-583c6d40-bed6-47dc-ad79-f3c053b6e89b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:11.829291 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-583c6d40-bed6-47dc-ad79-f3c053b6e89b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1314 microversion: 2.1 time: 0.177422 Aug 28 10:25:11.829892 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 460/936] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:11 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:12.566961 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-370eb1f9-1f9a-4d0a-85a6-65926bf4a1b4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:12.567728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-370eb1f9-1f9a-4d0a-85a6-65926bf4a1b4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:12.575570 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-370eb1f9-1f9a-4d0a-85a6-65926bf4a1b4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:12.576056 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-370eb1f9-1f9a-4d0a-85a6-65926bf4a1b4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:12.576451 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-370eb1f9-1f9a-4d0a-85a6-65926bf4a1b4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:12.577354 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-370eb1f9-1f9a-4d0a-85a6-65926bf4a1b4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:12.578008 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-370eb1f9-1f9a-4d0a-85a6-65926bf4a1b4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:12.578409 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-370eb1f9-1f9a-4d0a-85a6-65926bf4a1b4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:12.714959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-370eb1f9-1f9a-4d0a-85a6-65926bf4a1b4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:12.723675 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-370eb1f9-1f9a-4d0a-85a6-65926bf4a1b4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:12.725176 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-370eb1f9-1f9a-4d0a-85a6-65926bf4a1b4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:12.726315 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-370eb1f9-1f9a-4d0a-85a6-65926bf4a1b4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1729 microversion: 2.20 time: 0.163416 Aug 28 10:25:12.726880 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 477/937] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:12 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:12.850457 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-2a5435f2-de2f-4cf4-92e8-823703097890 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:12.851137 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-2a5435f2-de2f-4cf4-92e8-823703097890 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:12.858145 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2a5435f2-de2f-4cf4-92e8-823703097890 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:12.858658 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2a5435f2-de2f-4cf4-92e8-823703097890 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:12.859061 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2a5435f2-de2f-4cf4-92e8-823703097890 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:12.859764 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2a5435f2-de2f-4cf4-92e8-823703097890 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:12.860772 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2a5435f2-de2f-4cf4-92e8-823703097890 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:12.861415 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2a5435f2-de2f-4cf4-92e8-823703097890 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:13.002157 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-2a5435f2-de2f-4cf4-92e8-823703097890 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:13.010444 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-2a5435f2-de2f-4cf4-92e8-823703097890 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1314 microversion: 2.1 time: 0.164061 Aug 28 10:25:13.013277 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 461/938] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:12 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:13.750567 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a43212af-c444-43c6-9643-f4fcff00f14f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:13.751243 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a43212af-c444-43c6-9643-f4fcff00f14f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:13.757891 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a43212af-c444-43c6-9643-f4fcff00f14f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:13.758290 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a43212af-c444-43c6-9643-f4fcff00f14f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:13.758712 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a43212af-c444-43c6-9643-f4fcff00f14f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:13.759367 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a43212af-c444-43c6-9643-f4fcff00f14f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:13.759820 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a43212af-c444-43c6-9643-f4fcff00f14f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:13.760227 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a43212af-c444-43c6-9643-f4fcff00f14f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:13.894034 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a43212af-c444-43c6-9643-f4fcff00f14f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:13.902399 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a43212af-c444-43c6-9643-f4fcff00f14f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:13.903886 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a43212af-c444-43c6-9643-f4fcff00f14f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:13.905079 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a43212af-c444-43c6-9643-f4fcff00f14f tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1729 microversion: 2.20 time: 0.158506 Aug 28 10:25:13.905636 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 478/939] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:13 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:14.031829 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-80cacb46-2089-43fe-89d9-35b86f485620 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:14.032450 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-80cacb46-2089-43fe-89d9-35b86f485620 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:14.039466 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-80cacb46-2089-43fe-89d9-35b86f485620 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:14.040128 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-80cacb46-2089-43fe-89d9-35b86f485620 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:14.040690 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-80cacb46-2089-43fe-89d9-35b86f485620 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:14.041691 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-80cacb46-2089-43fe-89d9-35b86f485620 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:14.042264 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-80cacb46-2089-43fe-89d9-35b86f485620 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:14.042745 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-80cacb46-2089-43fe-89d9-35b86f485620 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:14.180361 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-80cacb46-2089-43fe-89d9-35b86f485620 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:14.188488 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-80cacb46-2089-43fe-89d9-35b86f485620 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1314 microversion: 2.1 time: 0.160768 Aug 28 10:25:14.189083 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 462/940] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:14 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:14.930530 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e5d58242-5165-4ea5-810b-e15a764d5a43 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:14.931176 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e5d58242-5165-4ea5-810b-e15a764d5a43 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:14.938181 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e5d58242-5165-4ea5-810b-e15a764d5a43 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:14.938645 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e5d58242-5165-4ea5-810b-e15a764d5a43 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:14.939067 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e5d58242-5165-4ea5-810b-e15a764d5a43 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:14.939781 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e5d58242-5165-4ea5-810b-e15a764d5a43 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:14.940221 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e5d58242-5165-4ea5-810b-e15a764d5a43 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:14.940687 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e5d58242-5165-4ea5-810b-e15a764d5a43 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:15.078166 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e5d58242-5165-4ea5-810b-e15a764d5a43 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:15.086768 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e5d58242-5165-4ea5-810b-e15a764d5a43 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:15.088380 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e5d58242-5165-4ea5-810b-e15a764d5a43 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:15.089837 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e5d58242-5165-4ea5-810b-e15a764d5a43 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1729 microversion: 2.20 time: 0.164442 Aug 28 10:25:15.090794 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 479/941] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:14 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:15.210412 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-aa6ffe29-a94a-45cc-9455-39e0272347f8 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:15.211097 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-aa6ffe29-a94a-45cc-9455-39e0272347f8 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:15.218219 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aa6ffe29-a94a-45cc-9455-39e0272347f8 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:15.218745 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aa6ffe29-a94a-45cc-9455-39e0272347f8 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:15.219172 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aa6ffe29-a94a-45cc-9455-39e0272347f8 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:15.219875 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aa6ffe29-a94a-45cc-9455-39e0272347f8 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:15.220320 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aa6ffe29-a94a-45cc-9455-39e0272347f8 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:15.220766 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aa6ffe29-a94a-45cc-9455-39e0272347f8 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:15.355327 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-aa6ffe29-a94a-45cc-9455-39e0272347f8 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:15.364544 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-aa6ffe29-a94a-45cc-9455-39e0272347f8 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1314 microversion: 2.1 time: 0.158439 Aug 28 10:25:15.370402 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 463/942] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:15 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:16.113234 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ec3b9798-c3e2-41fc-a37e-5286ae74b9ff tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:16.113888 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ec3b9798-c3e2-41fc-a37e-5286ae74b9ff tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:16.120965 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec3b9798-c3e2-41fc-a37e-5286ae74b9ff tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:16.121447 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec3b9798-c3e2-41fc-a37e-5286ae74b9ff tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:16.121869 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec3b9798-c3e2-41fc-a37e-5286ae74b9ff tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:16.122652 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec3b9798-c3e2-41fc-a37e-5286ae74b9ff tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:16.123095 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec3b9798-c3e2-41fc-a37e-5286ae74b9ff tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:16.123514 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec3b9798-c3e2-41fc-a37e-5286ae74b9ff tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:16.269315 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ec3b9798-c3e2-41fc-a37e-5286ae74b9ff tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:16.302668 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ec3b9798-c3e2-41fc-a37e-5286ae74b9ff tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:16.308305 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ec3b9798-c3e2-41fc-a37e-5286ae74b9ff tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:16.312046 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ec3b9798-c3e2-41fc-a37e-5286ae74b9ff tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1729 microversion: 2.20 time: 0.202704 Aug 28 10:25:16.326845 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 480/943] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:16 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:16.385377 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-16783eb2-3944-4d33-8a46-cc06b11798b1 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:16.386056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-16783eb2-3944-4d33-8a46-cc06b11798b1 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:16.392787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-16783eb2-3944-4d33-8a46-cc06b11798b1 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:16.393301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-16783eb2-3944-4d33-8a46-cc06b11798b1 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:16.393743 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-16783eb2-3944-4d33-8a46-cc06b11798b1 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:16.394444 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-16783eb2-3944-4d33-8a46-cc06b11798b1 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:16.394885 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-16783eb2-3944-4d33-8a46-cc06b11798b1 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:16.395325 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-16783eb2-3944-4d33-8a46-cc06b11798b1 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:16.531217 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-16783eb2-3944-4d33-8a46-cc06b11798b1 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:16.539010 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-16783eb2-3944-4d33-8a46-cc06b11798b1 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1314 microversion: 2.1 time: 0.157626 Aug 28 10:25:16.539570 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 464/944] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:16 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:17.346775 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-65db4e2a-c02b-4c97-acd6-566e1684944d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:17.348089 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-65db4e2a-c02b-4c97-acd6-566e1684944d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:17.350612 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:17.356323 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-65db4e2a-c02b-4c97-acd6-566e1684944d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:17.356932 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-65db4e2a-c02b-4c97-acd6-566e1684944d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:17.357349 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-65db4e2a-c02b-4c97-acd6-566e1684944d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:17.358010 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-65db4e2a-c02b-4c97-acd6-566e1684944d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:17.358476 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-65db4e2a-c02b-4c97-acd6-566e1684944d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:17.358886 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-65db4e2a-c02b-4c97-acd6-566e1684944d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:17.527155 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-65db4e2a-c02b-4c97-acd6-566e1684944d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:17.536356 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-65db4e2a-c02b-4c97-acd6-566e1684944d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:17.537763 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-65db4e2a-c02b-4c97-acd6-566e1684944d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:17.539145 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-65db4e2a-c02b-4c97-acd6-566e1684944d tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1729 microversion: 2.20 time: 0.196286 Aug 28 10:25:17.540215 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 481/945] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:17 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:17.561018 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4380698f-06d7-4cd0-b964-0b86bfeb8cb0 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:17.561701 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4380698f-06d7-4cd0-b964-0b86bfeb8cb0 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:17.563683 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=2 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:17.564343 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=6 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:17.570590 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4380698f-06d7-4cd0-b964-0b86bfeb8cb0 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:17.571093 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4380698f-06d7-4cd0-b964-0b86bfeb8cb0 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:17.571472 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4380698f-06d7-4cd0-b964-0b86bfeb8cb0 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:17.572179 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4380698f-06d7-4cd0-b964-0b86bfeb8cb0 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:17.572657 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4380698f-06d7-4cd0-b964-0b86bfeb8cb0 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:17.573052 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4380698f-06d7-4cd0-b964-0b86bfeb8cb0 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:17.711134 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4380698f-06d7-4cd0-b964-0b86bfeb8cb0 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:17.719454 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4380698f-06d7-4cd0-b964-0b86bfeb8cb0 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1314 microversion: 2.1 time: 0.162546 Aug 28 10:25:17.732558 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 465/946] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:17 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:18.562738 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5a94af2b-2b82-47b5-ae30-792c0eabf2b5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:18.563404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5a94af2b-2b82-47b5-ae30-792c0eabf2b5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:18.571554 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5a94af2b-2b82-47b5-ae30-792c0eabf2b5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:18.572286 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5a94af2b-2b82-47b5-ae30-792c0eabf2b5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:18.573019 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5a94af2b-2b82-47b5-ae30-792c0eabf2b5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:18.573908 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5a94af2b-2b82-47b5-ae30-792c0eabf2b5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:18.574349 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5a94af2b-2b82-47b5-ae30-792c0eabf2b5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:18.574756 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5a94af2b-2b82-47b5-ae30-792c0eabf2b5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:18.710927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5a94af2b-2b82-47b5-ae30-792c0eabf2b5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:18.720305 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5a94af2b-2b82-47b5-ae30-792c0eabf2b5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:18.721833 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5a94af2b-2b82-47b5-ae30-792c0eabf2b5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:18.723027 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5a94af2b-2b82-47b5-ae30-792c0eabf2b5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1729 microversion: 2.20 time: 0.164457 Aug 28 10:25:18.723590 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 482/947] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:18 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:18.744579 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e12bd249-43db-4d7e-aa5f-9ce7575b7901 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:18.746092 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e12bd249-43db-4d7e-aa5f-9ce7575b7901 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:18.753168 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e12bd249-43db-4d7e-aa5f-9ce7575b7901 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:18.753957 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e12bd249-43db-4d7e-aa5f-9ce7575b7901 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:18.754586 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e12bd249-43db-4d7e-aa5f-9ce7575b7901 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:18.755760 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e12bd249-43db-4d7e-aa5f-9ce7575b7901 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:18.756580 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e12bd249-43db-4d7e-aa5f-9ce7575b7901 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:18.757273 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e12bd249-43db-4d7e-aa5f-9ce7575b7901 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:18.899543 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-e12bd249-43db-4d7e-aa5f-9ce7575b7901 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:18.907862 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-e12bd249-43db-4d7e-aa5f-9ce7575b7901 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1314 microversion: 2.1 time: 0.167126 Aug 28 10:25:18.908557 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 466/948] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:18 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:19.751879 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9a5618cb-b32d-49ca-b882-7b094e7cfe83 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:19.752842 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9a5618cb-b32d-49ca-b882-7b094e7cfe83 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:19.763293 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9a5618cb-b32d-49ca-b882-7b094e7cfe83 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:19.763980 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9a5618cb-b32d-49ca-b882-7b094e7cfe83 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:19.764784 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9a5618cb-b32d-49ca-b882-7b094e7cfe83 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:19.765472 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9a5618cb-b32d-49ca-b882-7b094e7cfe83 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:19.765914 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9a5618cb-b32d-49ca-b882-7b094e7cfe83 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:19.766327 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9a5618cb-b32d-49ca-b882-7b094e7cfe83 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:19.896764 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9a5618cb-b32d-49ca-b882-7b094e7cfe83 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:19.905428 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9a5618cb-b32d-49ca-b882-7b094e7cfe83 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:19.906838 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9a5618cb-b32d-49ca-b882-7b094e7cfe83 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:19.907980 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9a5618cb-b32d-49ca-b882-7b094e7cfe83 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1729 microversion: 2.20 time: 0.162793 Aug 28 10:25:19.908532 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 483/949] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:19 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:19.929215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-0b094458-afa5-4de5-9a35-9e3ba36d65d4 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:19.929785 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-0b094458-afa5-4de5-9a35-9e3ba36d65d4 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:19.936471 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0b094458-afa5-4de5-9a35-9e3ba36d65d4 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:19.936978 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0b094458-afa5-4de5-9a35-9e3ba36d65d4 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:19.937403 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0b094458-afa5-4de5-9a35-9e3ba36d65d4 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:19.938074 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0b094458-afa5-4de5-9a35-9e3ba36d65d4 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:19.938515 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0b094458-afa5-4de5-9a35-9e3ba36d65d4 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:19.938924 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0b094458-afa5-4de5-9a35-9e3ba36d65d4 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:20.072331 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-0b094458-afa5-4de5-9a35-9e3ba36d65d4 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:20.080450 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-0b094458-afa5-4de5-9a35-9e3ba36d65d4 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1314 microversion: 2.1 time: 0.155098 Aug 28 10:25:20.081088 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 467/950] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:19 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:20.935319 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-93550627-91c8-481d-b761-3d0ee80a3fd8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:20.936296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-93550627-91c8-481d-b761-3d0ee80a3fd8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:20.947283 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-93550627-91c8-481d-b761-3d0ee80a3fd8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:20.948075 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-93550627-91c8-481d-b761-3d0ee80a3fd8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:20.948846 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-93550627-91c8-481d-b761-3d0ee80a3fd8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:20.949978 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-93550627-91c8-481d-b761-3d0ee80a3fd8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:20.950713 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-93550627-91c8-481d-b761-3d0ee80a3fd8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:20.951401 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-93550627-91c8-481d-b761-3d0ee80a3fd8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:21.092936 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-93550627-91c8-481d-b761-3d0ee80a3fd8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:21.101366 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f1475d74-4dee-424c-88c3-58e10af05056 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:21.101905 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-93550627-91c8-481d-b761-3d0ee80a3fd8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:21.102018 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f1475d74-4dee-424c-88c3-58e10af05056 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:21.103275 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-93550627-91c8-481d-b761-3d0ee80a3fd8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:21.104407 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-93550627-91c8-481d-b761-3d0ee80a3fd8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1729 microversion: 2.20 time: 0.175673 Aug 28 10:25:21.105031 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 484/951] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:20 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:21.108410 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f1475d74-4dee-424c-88c3-58e10af05056 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:21.108929 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f1475d74-4dee-424c-88c3-58e10af05056 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:21.109350 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f1475d74-4dee-424c-88c3-58e10af05056 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:21.110043 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f1475d74-4dee-424c-88c3-58e10af05056 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:21.110488 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f1475d74-4dee-424c-88c3-58e10af05056 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:21.110908 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f1475d74-4dee-424c-88c3-58e10af05056 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:21.256047 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f1475d74-4dee-424c-88c3-58e10af05056 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:21.263929 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f1475d74-4dee-424c-88c3-58e10af05056 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1314 microversion: 2.1 time: 0.166472 Aug 28 10:25:21.264555 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 468/952] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:21 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:22.128685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f9f6e890-51c7-49aa-b3f0-98108fceb203 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:22.129258 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f9f6e890-51c7-49aa-b3f0-98108fceb203 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:22.136396 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f9f6e890-51c7-49aa-b3f0-98108fceb203 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:22.136923 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f9f6e890-51c7-49aa-b3f0-98108fceb203 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:22.137341 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f9f6e890-51c7-49aa-b3f0-98108fceb203 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:22.138023 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f9f6e890-51c7-49aa-b3f0-98108fceb203 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:22.138462 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f9f6e890-51c7-49aa-b3f0-98108fceb203 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:22.138900 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f9f6e890-51c7-49aa-b3f0-98108fceb203 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:22.278839 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f9f6e890-51c7-49aa-b3f0-98108fceb203 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:22.284804 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f2e60995-078c-4f4e-8bac-2d7f1bfe0f24 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:22.285394 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f2e60995-078c-4f4e-8bac-2d7f1bfe0f24 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:22.288057 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f9f6e890-51c7-49aa-b3f0-98108fceb203 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:22.289519 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f9f6e890-51c7-49aa-b3f0-98108fceb203 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:22.290673 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f9f6e890-51c7-49aa-b3f0-98108fceb203 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1729 microversion: 2.20 time: 0.167042 Aug 28 10:25:22.291219 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 485/953] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:22 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:22.291962 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f2e60995-078c-4f4e-8bac-2d7f1bfe0f24 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:22.292439 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f2e60995-078c-4f4e-8bac-2d7f1bfe0f24 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:22.292902 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f2e60995-078c-4f4e-8bac-2d7f1bfe0f24 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:22.293591 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f2e60995-078c-4f4e-8bac-2d7f1bfe0f24 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:22.294352 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f2e60995-078c-4f4e-8bac-2d7f1bfe0f24 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:22.294804 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f2e60995-078c-4f4e-8bac-2d7f1bfe0f24 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:22.422890 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f2e60995-078c-4f4e-8bac-2d7f1bfe0f24 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:22.430783 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f2e60995-078c-4f4e-8bac-2d7f1bfe0f24 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1314 microversion: 2.1 time: 0.149904 Aug 28 10:25:22.431333 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 469/954] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:22 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:25:23.318101 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2ce2e0ac-8a36-4356-ba27-2175039a7176 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:23.319180 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2ce2e0ac-8a36-4356-ba27-2175039a7176 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:23.329712 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2ce2e0ac-8a36-4356-ba27-2175039a7176 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:23.330189 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2ce2e0ac-8a36-4356-ba27-2175039a7176 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:23.330614 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2ce2e0ac-8a36-4356-ba27-2175039a7176 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:23.331315 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2ce2e0ac-8a36-4356-ba27-2175039a7176 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:23.331776 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2ce2e0ac-8a36-4356-ba27-2175039a7176 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:23.332191 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2ce2e0ac-8a36-4356-ba27-2175039a7176 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:23.452298 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-357e8837-81a2-49e5-a977-a71b6bca6b27 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:23.452938 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-357e8837-81a2-49e5-a977-a71b6bca6b27 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:23.459934 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-357e8837-81a2-49e5-a977-a71b6bca6b27 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:23.460445 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-357e8837-81a2-49e5-a977-a71b6bca6b27 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:23.460931 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-357e8837-81a2-49e5-a977-a71b6bca6b27 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:23.461628 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-357e8837-81a2-49e5-a977-a71b6bca6b27 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:23.462075 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-357e8837-81a2-49e5-a977-a71b6bca6b27 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:23.462493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-357e8837-81a2-49e5-a977-a71b6bca6b27 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:23.466626 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:23.477124 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2ce2e0ac-8a36-4356-ba27-2175039a7176 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:23.499851 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2ce2e0ac-8a36-4356-ba27-2175039a7176 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:23.501485 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2ce2e0ac-8a36-4356-ba27-2175039a7176 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:23.502722 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2ce2e0ac-8a36-4356-ba27-2175039a7176 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1729 microversion: 2.20 time: 0.191347 Aug 28 10:25:23.503360 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 486/955] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:23 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:23.593261 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-357e8837-81a2-49e5-a977-a71b6bca6b27 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:23.601179 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-357e8837-81a2-49e5-a977-a71b6bca6b27 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1314 microversion: 2.1 time: 0.153153 Aug 28 10:25:23.601754 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 470/956] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:23 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:24.526288 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e3e42070-e2d2-4cdd-8b17-e7d7cfdc65ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:24.526897 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e3e42070-e2d2-4cdd-8b17-e7d7cfdc65ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:24.533751 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e3e42070-e2d2-4cdd-8b17-e7d7cfdc65ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:24.534235 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e3e42070-e2d2-4cdd-8b17-e7d7cfdc65ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:24.534666 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e3e42070-e2d2-4cdd-8b17-e7d7cfdc65ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:24.535362 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e3e42070-e2d2-4cdd-8b17-e7d7cfdc65ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:24.535840 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e3e42070-e2d2-4cdd-8b17-e7d7cfdc65ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:24.536251 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e3e42070-e2d2-4cdd-8b17-e7d7cfdc65ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:24.621833 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-1a7cac1d-09fb-4d9a-921e-859ec46bd3bc tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:24.622440 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-1a7cac1d-09fb-4d9a-921e-859ec46bd3bc tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:24.629468 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1a7cac1d-09fb-4d9a-921e-859ec46bd3bc tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:24.630035 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1a7cac1d-09fb-4d9a-921e-859ec46bd3bc tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:24.631506 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1a7cac1d-09fb-4d9a-921e-859ec46bd3bc tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:24.632238 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1a7cac1d-09fb-4d9a-921e-859ec46bd3bc tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:24.632746 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1a7cac1d-09fb-4d9a-921e-859ec46bd3bc tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:24.633281 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1a7cac1d-09fb-4d9a-921e-859ec46bd3bc tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:24.689032 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e3e42070-e2d2-4cdd-8b17-e7d7cfdc65ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:24.691807 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:24.699241 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e3e42070-e2d2-4cdd-8b17-e7d7cfdc65ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:24.700925 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e3e42070-e2d2-4cdd-8b17-e7d7cfdc65ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:24.702266 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e3e42070-e2d2-4cdd-8b17-e7d7cfdc65ea tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1729 microversion: 2.20 time: 0.179913 Aug 28 10:25:24.702839 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 487/957] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:24 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:24.771887 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-1a7cac1d-09fb-4d9a-921e-859ec46bd3bc tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:24.779720 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-1a7cac1d-09fb-4d9a-921e-859ec46bd3bc tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1314 microversion: 2.1 time: 0.161727 Aug 28 10:25:24.780272 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 471/958] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:24 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:25.725269 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-981ac926-e5f9-49dd-a7e7-f61b120a7dbb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:25.725867 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-981ac926-e5f9-49dd-a7e7-f61b120a7dbb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:25.734521 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-981ac926-e5f9-49dd-a7e7-f61b120a7dbb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:25.735001 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-981ac926-e5f9-49dd-a7e7-f61b120a7dbb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:25.735426 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-981ac926-e5f9-49dd-a7e7-f61b120a7dbb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:25.736122 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-981ac926-e5f9-49dd-a7e7-f61b120a7dbb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:25.736585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-981ac926-e5f9-49dd-a7e7-f61b120a7dbb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:25.737002 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-981ac926-e5f9-49dd-a7e7-f61b120a7dbb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:25.800996 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f67117ff-aca2-44ae-a824-77b840aa8744 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:25.802343 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f67117ff-aca2-44ae-a824-77b840aa8744 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:25.808955 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f67117ff-aca2-44ae-a824-77b840aa8744 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:25.809442 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f67117ff-aca2-44ae-a824-77b840aa8744 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:25.809860 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f67117ff-aca2-44ae-a824-77b840aa8744 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:25.810540 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f67117ff-aca2-44ae-a824-77b840aa8744 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:25.811353 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f67117ff-aca2-44ae-a824-77b840aa8744 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:25.812196 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f67117ff-aca2-44ae-a824-77b840aa8744 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:25.900671 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-981ac926-e5f9-49dd-a7e7-f61b120a7dbb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:25.909248 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-981ac926-e5f9-49dd-a7e7-f61b120a7dbb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:25.910715 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-981ac926-e5f9-49dd-a7e7-f61b120a7dbb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:25.911843 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-981ac926-e5f9-49dd-a7e7-f61b120a7dbb tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1729 microversion: 2.20 time: 0.190627 Aug 28 10:25:25.912563 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 488/959] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:25 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:25.958393 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f67117ff-aca2-44ae-a824-77b840aa8744 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:25.966258 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f67117ff-aca2-44ae-a824-77b840aa8744 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1314 microversion: 2.1 time: 0.169196 Aug 28 10:25:25.966835 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 472/960] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:25 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:26.935018 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-eb20bc57-878e-4378-8792-16633dc19ab1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:26.935755 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-eb20bc57-878e-4378-8792-16633dc19ab1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:26.942427 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eb20bc57-878e-4378-8792-16633dc19ab1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:26.942908 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eb20bc57-878e-4378-8792-16633dc19ab1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:26.943333 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eb20bc57-878e-4378-8792-16633dc19ab1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:26.944060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eb20bc57-878e-4378-8792-16633dc19ab1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:26.944526 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eb20bc57-878e-4378-8792-16633dc19ab1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:26.944930 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eb20bc57-878e-4378-8792-16633dc19ab1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:26.994161 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-794386b6-10fd-4d25-9097-463032b332ce tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:26.995270 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-794386b6-10fd-4d25-9097-463032b332ce tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:27.001718 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-794386b6-10fd-4d25-9097-463032b332ce tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:27.002207 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-794386b6-10fd-4d25-9097-463032b332ce tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:27.002665 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-794386b6-10fd-4d25-9097-463032b332ce tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:27.003354 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-794386b6-10fd-4d25-9097-463032b332ce tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:27.003827 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-794386b6-10fd-4d25-9097-463032b332ce tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:27.004198 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-794386b6-10fd-4d25-9097-463032b332ce tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:27.119705 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-eb20bc57-878e-4378-8792-16633dc19ab1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:27.128200 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-eb20bc57-878e-4378-8792-16633dc19ab1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:27.129674 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-eb20bc57-878e-4378-8792-16633dc19ab1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:27.130827 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-eb20bc57-878e-4378-8792-16633dc19ab1 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1729 microversion: 2.20 time: 0.200207 Aug 28 10:25:27.131397 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 489/961] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:26 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1729 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:27.150987 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-450a0483-a02f-43ba-9a9f-1d30d1aa918b req-c6e30f3a-df51-438a-9db1-3dd48c518019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6960433f-4e91-4c5b-9c8e-50645b6e13e7", "name": "network-vif-plugged", "status": "completed", "tag": "609522cc-a982-46e3-bc01-474519fee148"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:25:27.160954 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-450a0483-a02f-43ba-9a9f-1d30d1aa918b req-c6e30f3a-df51-438a-9db1-3dd48c518019 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:27.161423 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-450a0483-a02f-43ba-9a9f-1d30d1aa918b req-c6e30f3a-df51-438a-9db1-3dd48c518019 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:27.161836 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-450a0483-a02f-43ba-9a9f-1d30d1aa918b req-c6e30f3a-df51-438a-9db1-3dd48c518019 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:27.175290 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-450a0483-a02f-43ba-9a9f-1d30d1aa918b req-c6e30f3a-df51-438a-9db1-3dd48c518019 service nova] Creating event network-vif-plugged:609522cc-a982-46e3-bc01-474519fee148 for instance 6960433f-4e91-4c5b-9c8e-50645b6e13e7 on hv-cinder-85200 Aug 28 10:25:27.181235 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-450a0483-a02f-43ba-9a9f-1d30d1aa918b req-c6e30f3a-df51-438a-9db1-3dd48c518019 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033891 Aug 28 10:25:27.181856 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 490/962] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:25:27.395893 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-794386b6-10fd-4d25-9097-463032b332ce tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:27.403717 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-794386b6-10fd-4d25-9097-463032b332ce tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1314 microversion: 2.1 time: 0.413319 Aug 28 10:25:27.404300 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 473/963] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:26 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:28.158459 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a0146681-b2ff-42d9-87c3-bf3214da5be2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:28.159123 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a0146681-b2ff-42d9-87c3-bf3214da5be2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:28.166559 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a0146681-b2ff-42d9-87c3-bf3214da5be2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:28.167049 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a0146681-b2ff-42d9-87c3-bf3214da5be2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:28.167471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a0146681-b2ff-42d9-87c3-bf3214da5be2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:28.168250 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a0146681-b2ff-42d9-87c3-bf3214da5be2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:28.168747 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a0146681-b2ff-42d9-87c3-bf3214da5be2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:28.169516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a0146681-b2ff-42d9-87c3-bf3214da5be2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:28.312785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a0146681-b2ff-42d9-87c3-bf3214da5be2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:28.321883 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a0146681-b2ff-42d9-87c3-bf3214da5be2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:28.323308 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a0146681-b2ff-42d9-87c3-bf3214da5be2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:28.324463 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a0146681-b2ff-42d9-87c3-bf3214da5be2 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1729 microversion: 2.20 time: 0.172627 Aug 28 10:25:28.325068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 491/964] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:28 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:28.428014 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-0a59fd85-2fdc-44e7-bc1d-0c44205fe537 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:28.428890 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-0a59fd85-2fdc-44e7-bc1d-0c44205fe537 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:28.437999 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0a59fd85-2fdc-44e7-bc1d-0c44205fe537 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:28.438687 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0a59fd85-2fdc-44e7-bc1d-0c44205fe537 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:28.439263 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0a59fd85-2fdc-44e7-bc1d-0c44205fe537 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:28.440169 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0a59fd85-2fdc-44e7-bc1d-0c44205fe537 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:28.440802 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0a59fd85-2fdc-44e7-bc1d-0c44205fe537 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:28.441362 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0a59fd85-2fdc-44e7-bc1d-0c44205fe537 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:28.582843 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-0a59fd85-2fdc-44e7-bc1d-0c44205fe537 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:28.590715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-0a59fd85-2fdc-44e7-bc1d-0c44205fe537 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1314 microversion: 2.1 time: 0.168215 Aug 28 10:25:28.591294 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 474/965] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:28 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:29.351743 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4e3d23ae-780d-4e7e-9530-878d9e8158a8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:29.352660 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4e3d23ae-780d-4e7e-9530-878d9e8158a8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:29.362644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4e3d23ae-780d-4e7e-9530-878d9e8158a8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:29.363116 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4e3d23ae-780d-4e7e-9530-878d9e8158a8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:29.363537 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4e3d23ae-780d-4e7e-9530-878d9e8158a8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:29.364213 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4e3d23ae-780d-4e7e-9530-878d9e8158a8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:29.364685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4e3d23ae-780d-4e7e-9530-878d9e8158a8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:29.365094 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4e3d23ae-780d-4e7e-9530-878d9e8158a8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:29.509235 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4e3d23ae-780d-4e7e-9530-878d9e8158a8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:29.518605 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4e3d23ae-780d-4e7e-9530-878d9e8158a8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:29.523399 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4e3d23ae-780d-4e7e-9530-878d9e8158a8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:29.525341 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4e3d23ae-780d-4e7e-9530-878d9e8158a8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1729 microversion: 2.20 time: 0.179570 Aug 28 10:25:29.526731 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 492/966] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:29 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:29.611476 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e7092a32-4749-4c57-b79d-31d337be5106 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:29.612282 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e7092a32-4749-4c57-b79d-31d337be5106 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:29.619768 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e7092a32-4749-4c57-b79d-31d337be5106 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:29.620250 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e7092a32-4749-4c57-b79d-31d337be5106 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:29.620721 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e7092a32-4749-4c57-b79d-31d337be5106 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:29.621417 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e7092a32-4749-4c57-b79d-31d337be5106 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:29.621873 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e7092a32-4749-4c57-b79d-31d337be5106 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:29.622325 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e7092a32-4749-4c57-b79d-31d337be5106 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:29.774148 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-e7092a32-4749-4c57-b79d-31d337be5106 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:29.782349 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-e7092a32-4749-4c57-b79d-31d337be5106 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1314 microversion: 2.1 time: 0.174641 Aug 28 10:25:29.782811 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 475/967] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:29 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:30.548982 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6f1b0b06-2d99-409c-81df-cb28c8e9aba4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:30.549573 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6f1b0b06-2d99-409c-81df-cb28c8e9aba4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:30.556209 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f1b0b06-2d99-409c-81df-cb28c8e9aba4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:30.556723 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f1b0b06-2d99-409c-81df-cb28c8e9aba4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:30.557156 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f1b0b06-2d99-409c-81df-cb28c8e9aba4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:30.557841 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f1b0b06-2d99-409c-81df-cb28c8e9aba4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:30.558282 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f1b0b06-2d99-409c-81df-cb28c8e9aba4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:30.558699 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f1b0b06-2d99-409c-81df-cb28c8e9aba4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:30.700324 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6f1b0b06-2d99-409c-81df-cb28c8e9aba4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:30.709028 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6f1b0b06-2d99-409c-81df-cb28c8e9aba4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:30.710454 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6f1b0b06-2d99-409c-81df-cb28c8e9aba4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:30.711607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6f1b0b06-2d99-409c-81df-cb28c8e9aba4 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1716 microversion: 2.20 time: 0.166587 Aug 28 10:25:30.712183 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 493/968] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:25:30 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1716 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:25:30.803712 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-b6fb5d36-3a43-4c7b-83fe-452286fe48fa tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:30.804272 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-b6fb5d36-3a43-4c7b-83fe-452286fe48fa tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:30.811118 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b6fb5d36-3a43-4c7b-83fe-452286fe48fa tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:30.811594 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b6fb5d36-3a43-4c7b-83fe-452286fe48fa tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:30.812011 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b6fb5d36-3a43-4c7b-83fe-452286fe48fa tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:30.812730 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b6fb5d36-3a43-4c7b-83fe-452286fe48fa tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:30.813205 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b6fb5d36-3a43-4c7b-83fe-452286fe48fa tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:30.813620 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b6fb5d36-3a43-4c7b-83fe-452286fe48fa tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:30.946160 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-b6fb5d36-3a43-4c7b-83fe-452286fe48fa tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:30.954310 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-b6fb5d36-3a43-4c7b-83fe-452286fe48fa tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1314 microversion: 2.1 time: 0.154595 Aug 28 10:25:30.954919 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 476/969] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:30 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:31.003067 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-b887fcbb-2905-4629-ac9e-be673ad9f3e4 req-dba354a1-a00a-4ebe-b6d0-4d103129c8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f58d4ae7-1483-4df4-a66a-456ba4329c37", "name": "network-vif-plugged", "status": "completed", "tag": "3b08f2ab-8dd8-4b4e-90f9-7419bf78c3b3"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:25:31.012555 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-b887fcbb-2905-4629-ac9e-be673ad9f3e4 req-dba354a1-a00a-4ebe-b6d0-4d103129c8b8 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:31.012878 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-b887fcbb-2905-4629-ac9e-be673ad9f3e4 req-dba354a1-a00a-4ebe-b6d0-4d103129c8b8 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:31.013308 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-b887fcbb-2905-4629-ac9e-be673ad9f3e4 req-dba354a1-a00a-4ebe-b6d0-4d103129c8b8 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:31.024631 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-b887fcbb-2905-4629-ac9e-be673ad9f3e4 req-dba354a1-a00a-4ebe-b6d0-4d103129c8b8 service nova] Creating event network-vif-plugged:3b08f2ab-8dd8-4b4e-90f9-7419bf78c3b3 for instance f58d4ae7-1483-4df4-a66a-456ba4329c37 on hv-cinder-85200 Aug 28 10:25:31.029843 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-b887fcbb-2905-4629-ac9e-be673ad9f3e4 req-dba354a1-a00a-4ebe-b6d0-4d103129c8b8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030616 Aug 28 10:25:31.030426 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 494/970] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:25:31.978468 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-a354e019-be73-4a71-9e48-bbff5c481d69 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:31.979389 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-a354e019-be73-4a71-9e48-bbff5c481d69 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:31.990451 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a354e019-be73-4a71-9e48-bbff5c481d69 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:31.991258 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a354e019-be73-4a71-9e48-bbff5c481d69 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:31.991998 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a354e019-be73-4a71-9e48-bbff5c481d69 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:31.993206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a354e019-be73-4a71-9e48-bbff5c481d69 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:31.993997 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a354e019-be73-4a71-9e48-bbff5c481d69 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:31.994648 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a354e019-be73-4a71-9e48-bbff5c481d69 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:32.133428 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-a354e019-be73-4a71-9e48-bbff5c481d69 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:32.144200 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-a354e019-be73-4a71-9e48-bbff5c481d69 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1314 microversion: 2.1 time: 0.172226 Aug 28 10:25:32.144831 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 477/971] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:31 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:33.171956 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b9ea76a1-e489-4cd4-a56e-09659303941b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:33.173126 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b9ea76a1-e489-4cd4-a56e-09659303941b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:33.175684 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=62 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:33.182019 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b9ea76a1-e489-4cd4-a56e-09659303941b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:33.182498 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b9ea76a1-e489-4cd4-a56e-09659303941b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:33.182925 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b9ea76a1-e489-4cd4-a56e-09659303941b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:33.183605 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b9ea76a1-e489-4cd4-a56e-09659303941b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:33.184047 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b9ea76a1-e489-4cd4-a56e-09659303941b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:33.184452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b9ea76a1-e489-4cd4-a56e-09659303941b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:33.320651 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b9ea76a1-e489-4cd4-a56e-09659303941b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:33.332627 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b9ea76a1-e489-4cd4-a56e-09659303941b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1498 microversion: 2.1 time: 0.169493 Aug 28 10:25:33.333326 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 495/972] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:33 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1498 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:33.918961 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8ea8c9bc-08c8-4603-a721-15e824f8e58b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:33.919846 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-8ea8c9bc-08c8-4603-a721-15e824f8e58b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:33.926700 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8ea8c9bc-08c8-4603-a721-15e824f8e58b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:33.927191 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8ea8c9bc-08c8-4603-a721-15e824f8e58b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:33.927620 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8ea8c9bc-08c8-4603-a721-15e824f8e58b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:33.928305 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8ea8c9bc-08c8-4603-a721-15e824f8e58b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:33.928801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8ea8c9bc-08c8-4603-a721-15e824f8e58b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:33.929190 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8ea8c9bc-08c8-4603-a721-15e824f8e58b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:33.956626 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-8ea8c9bc-08c8-4603-a721-15e824f8e58b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Going to try to terminate instance {{(pid=120664) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 28 10:25:34.046033 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-8ea8c9bc-08c8-4603-a721-15e824f8e58b tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 204 len: 0 microversion: 2.1 time: 0.130621 Aug 28 10:25:34.046704 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 478/973] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:25:33 2022] DELETE /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 28 10:25:34.055477 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e49ca664-d89c-43fe-b229-ed711b6c77ac tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:34.056079 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e49ca664-d89c-43fe-b229-ed711b6c77ac tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:34.062470 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e49ca664-d89c-43fe-b229-ed711b6c77ac tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:34.062944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e49ca664-d89c-43fe-b229-ed711b6c77ac tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:34.063347 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e49ca664-d89c-43fe-b229-ed711b6c77ac tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:34.064024 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e49ca664-d89c-43fe-b229-ed711b6c77ac tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:34.064461 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e49ca664-d89c-43fe-b229-ed711b6c77ac tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:34.064940 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e49ca664-d89c-43fe-b229-ed711b6c77ac tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:34.198127 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e49ca664-d89c-43fe-b229-ed711b6c77ac tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:34.206451 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e49ca664-d89c-43fe-b229-ed711b6c77ac tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1504 microversion: 2.1 time: 0.154913 Aug 28 10:25:34.207031 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 496/974] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:34 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:35.229817 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e9ac3ec6-6b05-49c6-89f0-ab2766b35bdd tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:35.230667 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e9ac3ec6-6b05-49c6-89f0-ab2766b35bdd tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:35.233585 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:35.239631 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e9ac3ec6-6b05-49c6-89f0-ab2766b35bdd tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:35.240102 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e9ac3ec6-6b05-49c6-89f0-ab2766b35bdd tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:35.240542 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e9ac3ec6-6b05-49c6-89f0-ab2766b35bdd tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:35.241228 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e9ac3ec6-6b05-49c6-89f0-ab2766b35bdd tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:35.241668 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e9ac3ec6-6b05-49c6-89f0-ab2766b35bdd tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:35.242080 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e9ac3ec6-6b05-49c6-89f0-ab2766b35bdd tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:35.379357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-e9ac3ec6-6b05-49c6-89f0-ab2766b35bdd tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:35.387426 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-e9ac3ec6-6b05-49c6-89f0-ab2766b35bdd tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1504 microversion: 2.1 time: 0.162987 Aug 28 10:25:35.388025 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 479/975] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:35 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:36.249565 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-adc4c01c-3c52-4c2e-85de-55d479196ab7 req-4970f846-8ecb-4207-b7fd-ef80350a9503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f58d4ae7-1483-4df4-a66a-456ba4329c37", "name": "network-vif-deleted", "tag": "3b08f2ab-8dd8-4b4e-90f9-7419bf78c3b3"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:25:36.261306 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-adc4c01c-3c52-4c2e-85de-55d479196ab7 req-4970f846-8ecb-4207-b7fd-ef80350a9503 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:36.261768 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-adc4c01c-3c52-4c2e-85de-55d479196ab7 req-4970f846-8ecb-4207-b7fd-ef80350a9503 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:36.262184 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-adc4c01c-3c52-4c2e-85de-55d479196ab7 req-4970f846-8ecb-4207-b7fd-ef80350a9503 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:36.273989 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-adc4c01c-3c52-4c2e-85de-55d479196ab7 req-4970f846-8ecb-4207-b7fd-ef80350a9503 service nova] Creating event network-vif-deleted:3b08f2ab-8dd8-4b4e-90f9-7419bf78c3b3 for instance f58d4ae7-1483-4df4-a66a-456ba4329c37 on hv-cinder-85200 Aug 28 10:25:36.278972 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-adc4c01c-3c52-4c2e-85de-55d479196ab7 req-4970f846-8ecb-4207-b7fd-ef80350a9503 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033160 Aug 28 10:25:36.279586 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 497/976] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:25:36.408612 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-b24cf5ab-5e25-44e7-ba92-3c8fc5693d69 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:36.409206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-b24cf5ab-5e25-44e7-ba92-3c8fc5693d69 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:36.416021 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b24cf5ab-5e25-44e7-ba92-3c8fc5693d69 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:36.416528 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b24cf5ab-5e25-44e7-ba92-3c8fc5693d69 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:36.416969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b24cf5ab-5e25-44e7-ba92-3c8fc5693d69 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:36.417667 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b24cf5ab-5e25-44e7-ba92-3c8fc5693d69 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:36.418115 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b24cf5ab-5e25-44e7-ba92-3c8fc5693d69 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:36.418533 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b24cf5ab-5e25-44e7-ba92-3c8fc5693d69 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:36.451356 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b24cf5ab-5e25-44e7-ba92-3c8fc5693d69 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:36.451842 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b24cf5ab-5e25-44e7-ba92-3c8fc5693d69 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:36.452270 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b24cf5ab-5e25-44e7-ba92-3c8fc5693d69 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:36.452748 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.objects.instance [None req-b24cf5ab-5e25-44e7-ba92-3c8fc5693d69 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lazy-loading 'fault' on Instance uuid f58d4ae7-1483-4df4-a66a-456ba4329c37 {{(pid=120664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:25:36.494130 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-b24cf5ab-5e25-44e7-ba92-3c8fc5693d69 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b661e219b74f436bb668806a547f4778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e24ec2c109424ab964b4d441db44e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:36.502236 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-b24cf5ab-5e25-44e7-ba92-3c8fc5693d69 tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 200 len: 1304 microversion: 2.1 time: 0.097538 Aug 28 10:25:36.502992 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 480/977] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:36 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:37.528327 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7b8f9afa-e614-448f-ab73-fedf0079a62f tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:37.529551 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7b8f9afa-e614-448f-ab73-fedf0079a62f tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] [instance: f58d4ae7-1483-4df4-a66a-456ba4329c37] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:37.538679 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b8f9afa-e614-448f-ab73-fedf0079a62f tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:37.539149 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b8f9afa-e614-448f-ab73-fedf0079a62f tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:37.539566 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b8f9afa-e614-448f-ab73-fedf0079a62f tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:37.540211 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b8f9afa-e614-448f-ab73-fedf0079a62f tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:37.540716 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b8f9afa-e614-448f-ab73-fedf0079a62f tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:37.541126 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b8f9afa-e614-448f-ab73-fedf0079a62f tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:37.555320 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-7b8f9afa-e614-448f-ab73-fedf0079a62f tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] HTTP exception thrown: Instance f58d4ae7-1483-4df4-a66a-456ba4329c37 could not be found. Aug 28 10:25:37.556959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7b8f9afa-e614-448f-ab73-fedf0079a62f tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Request method failure captured: Aug 28 10:25:37.556959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 HTTP/1.1 Aug 28 10:25:37.556959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:25:37.556959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:25:37.556959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:25:37.556959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:25:37.556959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:25:37.556959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:25:37.556959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:25:37.556959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:25:37.556959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0JtOm3J8szJqkMErNl3K4IokzWiGBnloYFm9ntv1bqyVXi3fd-ZyjoXNcGUgR9ufvkoVZa_esiEyLy_nCrarf0rp-_uQ4qcfsTOtX7E-lQDlxLMxlmaa4dy7hY5AOIoG1IVq5cADPMgDLHUBY27R7U8Zyykq0V0SUjMCqx2nhJIxww Aug 28 10:25:37.556959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:25:37.556959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:25:37.556959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:25:37.556959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:25:37.556959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:25:37.556959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:25:37.556959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 75e24ec2c109424ab964b4d441db44e7 Aug 28 10:25:37.556959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesActionsTest-890997455 Aug 28 10:25:37.556959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:25:37.556959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:25:37.558548 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_75e24ec2c109424ab964b4d441db44e7", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/75e24ec2c109424ab964b4d441db44e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/75e24ec2c109424ab964b4d441db44e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/75e24ec2c109424ab964b4d441db44e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:25:37.558548 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesActionsTest-890997455 Aug 28 10:25:37.558548 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 75e24ec2c109424ab964b4d441db44e7 Aug 28 10:25:37.558548 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesActionsTest-890997455 Aug 28 10:25:37.558548 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesActionsTest-890997455-project Aug 28 10:25:37.558548 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:25:37.558548 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:25:37.558548 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: b661e219b74f436bb668806a547f4778 Aug 28 10:25:37.558548 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesActionsTest-890997455-project Aug 28 10:25:37.558548 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: > Aug 28 10:25:37.558548 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Instance f58d4ae7-1483-4df4-a66a-456ba4329c37 could not be found. Aug 28 10:25:37.558548 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'id': 'f58d4ae7-1483-4df4-a66a-456ba4329c37'} Aug 28 10:25:37.559331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:25:37.559331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:25:37.559331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:25:37.559331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:25:37.559331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:25:37.559331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:25:37.559331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:25:37.559331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:25:37.559331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:25:37.559331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:25:37.559331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f58d4ae7-1483-4df4-a66a-456ba4329c37 could not be found. Aug 28 10:25:37.559331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:25:37.559331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:25:37.559331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:25:37.559331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:25:37.559331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:25:37.559331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:25:37.559331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:25:37.559331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:25:37.559331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:25:37.560703 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:25:37.560703 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:25:37.560703 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:25:37.560703 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:25:37.560703 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:25:37.560703 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:25:37.560703 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:25:37.560703 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f58d4ae7-1483-4df4-a66a-456ba4329c37 could not be found. Aug 28 10:25:37.560703 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:25:37.560703 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:25:37.560703 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:25:37.560703 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:25:37.560703 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:25:37.560703 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:25:37.560703 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:25:37.560703 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:25:37.560703 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f58d4ae7-1483-4df4-a66a-456ba4329c37 could not be found. Aug 28 10:25:37.560703 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:25:37.561899 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7b8f9afa-e614-448f-ab73-fedf0079a62f tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] Returning 404 to user: Instance f58d4ae7-1483-4df4-a66a-456ba4329c37 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:25:37.561899 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7b8f9afa-e614-448f-ab73-fedf0079a62f tempest-VolumesActionsTest-890997455 tempest-VolumesActionsTest-890997455-project] 10.222.0.40 "GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37" status: 404 len: 111 microversion: 2.1 time: 0.036939 Aug 28 10:25:37.561899 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 498/978] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:37 2022] GET /compute/v2.1/servers/f58d4ae7-1483-4df4-a66a-456ba4329c37 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:25:45.108315 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-d55e87b8-4669-41d4-a717-4061efc2fb29 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:45.109826 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-d55e87b8-4669-41d4-a717-4061efc2fb29 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:45.117091 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d55e87b8-4669-41d4-a717-4061efc2fb29 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:45.117903 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d55e87b8-4669-41d4-a717-4061efc2fb29 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:45.118411 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d55e87b8-4669-41d4-a717-4061efc2fb29 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:45.119203 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d55e87b8-4669-41d4-a717-4061efc2fb29 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:45.119722 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d55e87b8-4669-41d4-a717-4061efc2fb29 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:45.120203 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d55e87b8-4669-41d4-a717-4061efc2fb29 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:45.150282 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-d55e87b8-4669-41d4-a717-4061efc2fb29 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Going to try to terminate instance {{(pid=120664) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 28 10:25:45.246734 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-d55e87b8-4669-41d4-a717-4061efc2fb29 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b" status: 204 len: 0 microversion: 2.1 time: 0.139977 Aug 28 10:25:45.250961 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 481/979] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:25:45 2022] DELETE /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 28 10:25:45.256201 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ca709de3-e2f7-4ebb-acf8-9d47ef243f3b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:45.256957 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ca709de3-e2f7-4ebb-acf8-9d47ef243f3b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:45.267871 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ca709de3-e2f7-4ebb-acf8-9d47ef243f3b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:45.268358 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ca709de3-e2f7-4ebb-acf8-9d47ef243f3b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:45.268839 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ca709de3-e2f7-4ebb-acf8-9d47ef243f3b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:45.269657 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ca709de3-e2f7-4ebb-acf8-9d47ef243f3b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:45.270108 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ca709de3-e2f7-4ebb-acf8-9d47ef243f3b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:45.270521 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ca709de3-e2f7-4ebb-acf8-9d47ef243f3b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:45.442335 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ca709de3-e2f7-4ebb-acf8-9d47ef243f3b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:45.452567 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ca709de3-e2f7-4ebb-acf8-9d47ef243f3b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b" status: 200 len: 1575 microversion: 2.1 time: 0.200355 Aug 28 10:25:45.466758 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 499/980] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:45 2022] GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b => generated 1575 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:46.475718 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-1821461c-88bf-45d5-ac1a-5c90931ad781 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:46.476391 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-1821461c-88bf-45d5-ac1a-5c90931ad781 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:46.483231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1821461c-88bf-45d5-ac1a-5c90931ad781 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:46.483813 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1821461c-88bf-45d5-ac1a-5c90931ad781 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:46.484418 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1821461c-88bf-45d5-ac1a-5c90931ad781 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:46.485448 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1821461c-88bf-45d5-ac1a-5c90931ad781 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:46.486097 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1821461c-88bf-45d5-ac1a-5c90931ad781 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:46.486688 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1821461c-88bf-45d5-ac1a-5c90931ad781 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:46.730358 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-1821461c-88bf-45d5-ac1a-5c90931ad781 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:46.738522 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-1821461c-88bf-45d5-ac1a-5c90931ad781 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b" status: 200 len: 1575 microversion: 2.1 time: 0.267426 Aug 28 10:25:46.753813 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 482/981] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:46 2022] GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b => generated 1575 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:47.764376 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-57cdbae1-9654-4d84-9393-61cb1f4d6913 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:47.766137 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-57cdbae1-9654-4d84-9393-61cb1f4d6913 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:47.774262 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-57cdbae1-9654-4d84-9393-61cb1f4d6913 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:47.775104 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-57cdbae1-9654-4d84-9393-61cb1f4d6913 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:47.775738 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-57cdbae1-9654-4d84-9393-61cb1f4d6913 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:47.776443 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-57cdbae1-9654-4d84-9393-61cb1f4d6913 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:47.776918 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-57cdbae1-9654-4d84-9393-61cb1f4d6913 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:47.777676 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-57cdbae1-9654-4d84-9393-61cb1f4d6913 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:48.025091 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-57cdbae1-9654-4d84-9393-61cb1f4d6913 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:48.034334 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-57cdbae1-9654-4d84-9393-61cb1f4d6913 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b" status: 200 len: 1575 microversion: 2.1 time: 0.275959 Aug 28 10:25:48.035207 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 500/982] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:47 2022] GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b => generated 1575 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:48.593956 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-0ce2fe21-dbf4-46eb-bc41-1798c596a262 req-6b31a11b-714e-42dc-8539-ea3caf457666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b", "name": "network-vif-deleted", "tag": "680e36a2-6344-4ef9-89ec-012960185e19"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:25:48.612440 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-0ce2fe21-dbf4-46eb-bc41-1798c596a262 req-6b31a11b-714e-42dc-8539-ea3caf457666 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:48.613324 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-0ce2fe21-dbf4-46eb-bc41-1798c596a262 req-6b31a11b-714e-42dc-8539-ea3caf457666 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:48.613422 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-0ce2fe21-dbf4-46eb-bc41-1798c596a262 req-6b31a11b-714e-42dc-8539-ea3caf457666 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:48.627331 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:48.630944 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-0ce2fe21-dbf4-46eb-bc41-1798c596a262 req-6b31a11b-714e-42dc-8539-ea3caf457666 service nova] Creating event network-vif-deleted:680e36a2-6344-4ef9-89ec-012960185e19 for instance 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b on hv-cinder-85200 Aug 28 10:25:48.638086 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-0ce2fe21-dbf4-46eb-bc41-1798c596a262 req-6b31a11b-714e-42dc-8539-ea3caf457666 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047658 Aug 28 10:25:48.638949 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 483/983] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:25:49.056457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-16efaf8b-9d10-4bed-9438-33ba4668acc2 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:49.059274 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-16efaf8b-9d10-4bed-9438-33ba4668acc2 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:49.067554 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-16efaf8b-9d10-4bed-9438-33ba4668acc2 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:49.068050 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-16efaf8b-9d10-4bed-9438-33ba4668acc2 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:49.068482 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-16efaf8b-9d10-4bed-9438-33ba4668acc2 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:49.069251 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-16efaf8b-9d10-4bed-9438-33ba4668acc2 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:49.069706 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-16efaf8b-9d10-4bed-9438-33ba4668acc2 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:49.070176 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-16efaf8b-9d10-4bed-9438-33ba4668acc2 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:49.156198 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-16efaf8b-9d10-4bed-9438-33ba4668acc2 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:49.172979 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-16efaf8b-9d10-4bed-9438-33ba4668acc2 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b" status: 200 len: 1225 microversion: 2.1 time: 0.120827 Aug 28 10:25:49.173702 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 501/984] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:49 2022] GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b => generated 1225 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:50.204474 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-aa864022-8cd2-4473-8ebb-2e666d5e8263 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:50.205406 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-aa864022-8cd2-4473-8ebb-2e666d5e8263 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:50.212855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aa864022-8cd2-4473-8ebb-2e666d5e8263 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:50.213661 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aa864022-8cd2-4473-8ebb-2e666d5e8263 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:50.214328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aa864022-8cd2-4473-8ebb-2e666d5e8263 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:50.215244 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aa864022-8cd2-4473-8ebb-2e666d5e8263 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:50.215898 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aa864022-8cd2-4473-8ebb-2e666d5e8263 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:50.216562 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aa864022-8cd2-4473-8ebb-2e666d5e8263 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:50.232829 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-aa864022-8cd2-4473-8ebb-2e666d5e8263 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] HTTP exception thrown: Instance 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b could not be found. Aug 28 10:25:50.234787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-aa864022-8cd2-4473-8ebb-2e666d5e8263 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Request method failure captured: Aug 28 10:25:50.234787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b HTTP/1.1 Aug 28 10:25:50.234787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:25:50.234787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:25:50.234787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:25:50.234787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:25:50.234787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:25:50.234787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:25:50.234787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:25:50.234787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:25:50.234787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0HTQZUOEwO5Qxo8TKaE1k29hFxRdBVXdLf-FAAa9VAs64CflXSgjlm6gvIGeVncZ1GkZbGZeCyoZzZmQ1FfLUjGWbMtylqhLcOqeawFD5n9A_b9VuahU95qV4H-g4QOhKuFk93vAeakTA71WUCg7U3WEYRUaup3HOfv9A9GZp6EkOA Aug 28 10:25:50.234787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:25:50.234787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:25:50.234787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:25:50.234787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:25:50.234787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:25:50.234787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:25:50.234787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: af70fccdef544a499725509ccd8c545f Aug 28 10:25:50.234787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-TestVolumeBootPattern-1181474048 Aug 28 10:25:50.234787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:25:50.234787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:25:50.236953 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af70fccdef544a499725509ccd8c545f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af70fccdef544a499725509ccd8c545f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af70fccdef544a499725509ccd8c545f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af70fccdef544a499725509ccd8c545f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:25:50.236953 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-TestVolumeBootPattern-1181474048 Aug 28 10:25:50.236953 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: af70fccdef544a499725509ccd8c545f Aug 28 10:25:50.236953 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-TestVolumeBootPattern-1181474048 Aug 28 10:25:50.236953 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-TestVolumeBootPattern-1181474048-project Aug 28 10:25:50.236953 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:25:50.236953 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:25:50.236953 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: 3deb7adb33004f1097574470754611ec Aug 28 10:25:50.236953 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-TestVolumeBootPattern-1181474048-project Aug 28 10:25:50.236953 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: > Aug 28 10:25:50.236953 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Instance 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b could not be found. Aug 28 10:25:50.236953 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': '2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b'} Aug 28 10:25:50.238154 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:25:50.238154 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:25:50.238154 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:25:50.238154 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:25:50.238154 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:25:50.238154 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:25:50.238154 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:25:50.238154 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:25:50.238154 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:25:50.238154 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:25:50.238154 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b could not be found. Aug 28 10:25:50.238154 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:25:50.238154 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:25:50.238154 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:25:50.238154 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:25:50.238154 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:25:50.238154 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:25:50.238154 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:25:50.238154 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:25:50.238154 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:25:50.240166 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:25:50.240166 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:25:50.240166 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:25:50.240166 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:25:50.240166 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:25:50.240166 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:25:50.240166 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:25:50.240166 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b could not be found. Aug 28 10:25:50.240166 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:25:50.240166 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:25:50.240166 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:25:50.240166 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:25:50.240166 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:25:50.240166 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:25:50.240166 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:25:50.240166 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:25:50.240166 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b could not be found. Aug 28 10:25:50.240166 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:25:50.241641 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-aa864022-8cd2-4473-8ebb-2e666d5e8263 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Returning 404 to user: Instance 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:25:50.241641 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-aa864022-8cd2-4473-8ebb-2e666d5e8263 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b" status: 404 len: 111 microversion: 2.1 time: 0.037882 Aug 28 10:25:50.248944 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 484/985] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:50 2022] GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:25:50.359850 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3758a9c2-f078-4ee8-80ae-041f7bc3098e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1976626691", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-413008888", "security_groups": [{"name": "tempest-secgroup-smoke-42242114"}], "block_device_mapping_v2": [{"uuid": "41f18a79-fc21-4450-888d-0c6a77eb7686", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "90d5e7eb-f02c-47a7-8a0d-74e76461cf4f"}]}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:25:50.521726 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-3758a9c2-f078-4ee8-80ae-041f7bc3098e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] validate_networks() for [('90d5e7eb-f02c-47a7-8a0d-74e76461cf4f', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 28 10:25:50.960013 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-3758a9c2-f078-4ee8-80ae-041f7bc3098e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 28 10:25:50.960434 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-3758a9c2-f078-4ee8-80ae-041f7bc3098e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 28 10:25:50.960932 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-3758a9c2-f078-4ee8-80ae-041f7bc3098e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 28 10:25:50.961548 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-3758a9c2-f078-4ee8-80ae-041f7bc3098e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 28 10:25:50.962183 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-3758a9c2-f078-4ee8-80ae-041f7bc3098e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 28 10:25:50.973553 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3758a9c2-f078-4ee8-80ae-041f7bc3098e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:50.974129 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3758a9c2-f078-4ee8-80ae-041f7bc3098e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:50.974562 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3758a9c2-f078-4ee8-80ae-041f7bc3098e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:50.975294 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3758a9c2-f078-4ee8-80ae-041f7bc3098e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:50.975778 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3758a9c2-f078-4ee8-80ae-041f7bc3098e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:50.976253 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3758a9c2-f078-4ee8-80ae-041f7bc3098e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:50.995716 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-3758a9c2-f078-4ee8-80ae-041f7bc3098e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Getting quotas for project af70fccdef544a499725509ccd8c545f. Resources: {'instances', 'cores', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:25:51.000191 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-3758a9c2-f078-4ee8-80ae-041f7bc3098e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Getting quotas for user 3deb7adb33004f1097574470754611ec and project af70fccdef544a499725509ccd8c545f. Resources: {'instances', 'cores', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:25:51.083222 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3758a9c2-f078-4ee8-80ae-041f7bc3098e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 28 10:25:51.085402 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3758a9c2-f078-4ee8-80ae-041f7bc3098e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 7745d041-7a19-4bb0-912e-a1f0b361c559] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='41f18a79-fc21-4450-888d-0c6a77eb7686',volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 28 10:25:51.239963 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3758a9c2-f078-4ee8-80ae-041f7bc3098e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.883850 Aug 28 10:25:51.247147 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 502/986] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Aug 28 10:25:50 2022] POST /compute/v2.1/servers => generated 404 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 28 10:25:51.253407 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-321ccec5-1ee9-4ac5-b423-e2d1408a87c2 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:51.254876 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-321ccec5-1ee9-4ac5-b423-e2d1408a87c2 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 7745d041-7a19-4bb0-912e-a1f0b361c559] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:51.320794 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-321ccec5-1ee9-4ac5-b423-e2d1408a87c2 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:51.328218 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-321ccec5-1ee9-4ac5-b423-e2d1408a87c2 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559" status: 200 len: 1094 microversion: 2.1 time: 0.080198 Aug 28 10:25:51.333151 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 485/987] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:51 2022] GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559 => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:25:52.353704 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1a4a8f13-7019-4a0e-b0ef-131bdc3c6cc8 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:52.354560 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1a4a8f13-7019-4a0e-b0ef-131bdc3c6cc8 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 7745d041-7a19-4bb0-912e-a1f0b361c559] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:52.361581 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a4a8f13-7019-4a0e-b0ef-131bdc3c6cc8 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:52.362472 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a4a8f13-7019-4a0e-b0ef-131bdc3c6cc8 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:52.363183 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a4a8f13-7019-4a0e-b0ef-131bdc3c6cc8 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:52.364017 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a4a8f13-7019-4a0e-b0ef-131bdc3c6cc8 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:52.364697 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a4a8f13-7019-4a0e-b0ef-131bdc3c6cc8 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:52.365234 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a4a8f13-7019-4a0e-b0ef-131bdc3c6cc8 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:52.431871 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1a4a8f13-7019-4a0e-b0ef-131bdc3c6cc8 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:52.449582 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1a4a8f13-7019-4a0e-b0ef-131bdc3c6cc8 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559" status: 200 len: 1192 microversion: 2.1 time: 0.100268 Aug 28 10:25:52.450709 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 503/988] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:52 2022] GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559 => generated 1192 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:53.471742 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-39f13c7d-d6df-4f41-be1b-4a9c41386155 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:53.472623 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-39f13c7d-d6df-4f41-be1b-4a9c41386155 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 7745d041-7a19-4bb0-912e-a1f0b361c559] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:53.489121 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-39f13c7d-d6df-4f41-be1b-4a9c41386155 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:53.489891 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-39f13c7d-d6df-4f41-be1b-4a9c41386155 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:53.490482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-39f13c7d-d6df-4f41-be1b-4a9c41386155 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:53.491374 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-39f13c7d-d6df-4f41-be1b-4a9c41386155 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:53.492493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-39f13c7d-d6df-4f41-be1b-4a9c41386155 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:53.492982 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-39f13c7d-d6df-4f41-be1b-4a9c41386155 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:53.769522 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-39f13c7d-d6df-4f41-be1b-4a9c41386155 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:53.779982 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-39f13c7d-d6df-4f41-be1b-4a9c41386155 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559" status: 200 len: 1276 microversion: 2.1 time: 0.312881 Aug 28 10:25:53.790660 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 486/989] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:53 2022] GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559 => generated 1276 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:54.318008 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-b00518b0-5177-4d9b-81bd-c6b8f0d552ad req-84552fea-e983-4271-96de-514961b83a45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7745d041-7a19-4bb0-912e-a1f0b361c559", "tag": "4e71047e-d04d-4098-862c-39240d4ddcfc"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:25:54.347312 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-b00518b0-5177-4d9b-81bd-c6b8f0d552ad req-84552fea-e983-4271-96de-514961b83a45 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:54.348668 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-b00518b0-5177-4d9b-81bd-c6b8f0d552ad req-84552fea-e983-4271-96de-514961b83a45 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:54.350398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-b00518b0-5177-4d9b-81bd-c6b8f0d552ad req-84552fea-e983-4271-96de-514961b83a45 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:54.382541 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-b00518b0-5177-4d9b-81bd-c6b8f0d552ad req-84552fea-e983-4271-96de-514961b83a45 service nova] Creating event network-changed:4e71047e-d04d-4098-862c-39240d4ddcfc for instance 7745d041-7a19-4bb0-912e-a1f0b361c559 on hv-cinder-85200 Aug 28 10:25:54.388831 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-b00518b0-5177-4d9b-81bd-c6b8f0d552ad req-84552fea-e983-4271-96de-514961b83a45 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074668 Aug 28 10:25:54.389870 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 504/990] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:25:54.808009 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4c8ae55f-3145-4721-9bb4-844d34a5568c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:54.808691 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4c8ae55f-3145-4721-9bb4-844d34a5568c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 7745d041-7a19-4bb0-912e-a1f0b361c559] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:54.821674 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4c8ae55f-3145-4721-9bb4-844d34a5568c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:54.822315 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4c8ae55f-3145-4721-9bb4-844d34a5568c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:54.822781 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4c8ae55f-3145-4721-9bb4-844d34a5568c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:54.823507 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4c8ae55f-3145-4721-9bb4-844d34a5568c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:54.823958 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4c8ae55f-3145-4721-9bb4-844d34a5568c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:54.824382 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4c8ae55f-3145-4721-9bb4-844d34a5568c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:54.973048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4c8ae55f-3145-4721-9bb4-844d34a5568c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:54.987046 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4c8ae55f-3145-4721-9bb4-844d34a5568c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559" status: 200 len: 1264 microversion: 2.1 time: 0.189299 Aug 28 10:25:54.987645 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 487/991] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:54 2022] GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559 => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:56.023590 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-22c646f8-99e9-4cf0-abb8-7d5a609b2688 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:56.024282 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-22c646f8-99e9-4cf0-abb8-7d5a609b2688 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 7745d041-7a19-4bb0-912e-a1f0b361c559] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:56.030470 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-22c646f8-99e9-4cf0-abb8-7d5a609b2688 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:56.030938 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-22c646f8-99e9-4cf0-abb8-7d5a609b2688 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:56.031779 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-22c646f8-99e9-4cf0-abb8-7d5a609b2688 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:56.032350 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-22c646f8-99e9-4cf0-abb8-7d5a609b2688 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:56.032572 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-22c646f8-99e9-4cf0-abb8-7d5a609b2688 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:56.032918 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-22c646f8-99e9-4cf0-abb8-7d5a609b2688 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:56.039508 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=80 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:56.184247 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-22c646f8-99e9-4cf0-abb8-7d5a609b2688 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:56.193369 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-22c646f8-99e9-4cf0-abb8-7d5a609b2688 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559" status: 200 len: 1264 microversion: 2.1 time: 0.174449 Aug 28 10:25:56.194503 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 505/992] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:56 2022] GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:57.216797 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-099f3147-f855-499c-87be-52dcba0f6133 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:57.217355 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-099f3147-f855-499c-87be-52dcba0f6133 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 7745d041-7a19-4bb0-912e-a1f0b361c559] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:57.226114 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-099f3147-f855-499c-87be-52dcba0f6133 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:57.226613 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-099f3147-f855-499c-87be-52dcba0f6133 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:57.227048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-099f3147-f855-499c-87be-52dcba0f6133 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:57.227963 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-099f3147-f855-499c-87be-52dcba0f6133 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:57.228426 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-099f3147-f855-499c-87be-52dcba0f6133 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:57.228898 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-099f3147-f855-499c-87be-52dcba0f6133 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:57.420767 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-099f3147-f855-499c-87be-52dcba0f6133 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:57.430430 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-099f3147-f855-499c-87be-52dcba0f6133 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559" status: 200 len: 1264 microversion: 2.1 time: 0.218642 Aug 28 10:25:57.444550 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 488/993] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:57 2022] GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559 => generated 1264 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:58.451561 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-217ef490-22be-4033-8148-208b7b73ccb5 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:58.452062 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-217ef490-22be-4033-8148-208b7b73ccb5 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 7745d041-7a19-4bb0-912e-a1f0b361c559] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:58.459333 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-217ef490-22be-4033-8148-208b7b73ccb5 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:58.459816 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-217ef490-22be-4033-8148-208b7b73ccb5 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:58.460244 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-217ef490-22be-4033-8148-208b7b73ccb5 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:58.460974 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-217ef490-22be-4033-8148-208b7b73ccb5 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:58.461421 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-217ef490-22be-4033-8148-208b7b73ccb5 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:58.461841 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-217ef490-22be-4033-8148-208b7b73ccb5 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:58.596117 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-217ef490-22be-4033-8148-208b7b73ccb5 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:58.604210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-217ef490-22be-4033-8148-208b7b73ccb5 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559" status: 200 len: 1264 microversion: 2.1 time: 0.156705 Aug 28 10:25:58.604811 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 506/994] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:58 2022] GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:25:59.625460 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f120f3ef-0402-44fd-9942-49f43aee61ec tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:25:59.626074 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f120f3ef-0402-44fd-9942-49f43aee61ec tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 7745d041-7a19-4bb0-912e-a1f0b361c559] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:25:59.632481 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f120f3ef-0402-44fd-9942-49f43aee61ec tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:59.633006 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f120f3ef-0402-44fd-9942-49f43aee61ec tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:59.633438 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f120f3ef-0402-44fd-9942-49f43aee61ec tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:59.634126 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f120f3ef-0402-44fd-9942-49f43aee61ec tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:25:59.634577 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f120f3ef-0402-44fd-9942-49f43aee61ec tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:25:59.635001 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f120f3ef-0402-44fd-9942-49f43aee61ec tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:25:59.778342 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f120f3ef-0402-44fd-9942-49f43aee61ec tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:25:59.786418 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f120f3ef-0402-44fd-9942-49f43aee61ec tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559" status: 200 len: 1264 microversion: 2.1 time: 0.165323 Aug 28 10:25:59.786984 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 489/995] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:25:59 2022] GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:00.807456 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c6b5b3f2-30bc-4ada-b8b0-0b088be69e0e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:00.808074 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c6b5b3f2-30bc-4ada-b8b0-0b088be69e0e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 7745d041-7a19-4bb0-912e-a1f0b361c559] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:00.814966 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6b5b3f2-30bc-4ada-b8b0-0b088be69e0e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:00.815447 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6b5b3f2-30bc-4ada-b8b0-0b088be69e0e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:00.816080 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6b5b3f2-30bc-4ada-b8b0-0b088be69e0e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:00.816809 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6b5b3f2-30bc-4ada-b8b0-0b088be69e0e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:00.817257 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6b5b3f2-30bc-4ada-b8b0-0b088be69e0e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:00.817725 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6b5b3f2-30bc-4ada-b8b0-0b088be69e0e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:00.949761 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c6b5b3f2-30bc-4ada-b8b0-0b088be69e0e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:00.958216 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c6b5b3f2-30bc-4ada-b8b0-0b088be69e0e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559" status: 200 len: 1264 microversion: 2.1 time: 0.154669 Aug 28 10:26:00.958760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 507/996] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:00 2022] GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:01.979274 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8711ab8e-451e-4464-8a7c-d74b1d1f88ad tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:01.980670 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-8711ab8e-451e-4464-8a7c-d74b1d1f88ad tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 7745d041-7a19-4bb0-912e-a1f0b361c559] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:01.983188 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=2 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:01.988832 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8711ab8e-451e-4464-8a7c-d74b1d1f88ad tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:01.989370 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8711ab8e-451e-4464-8a7c-d74b1d1f88ad tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:01.989868 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8711ab8e-451e-4464-8a7c-d74b1d1f88ad tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:01.990551 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8711ab8e-451e-4464-8a7c-d74b1d1f88ad tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:01.991086 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8711ab8e-451e-4464-8a7c-d74b1d1f88ad tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:01.991499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8711ab8e-451e-4464-8a7c-d74b1d1f88ad tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:02.127014 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8711ab8e-451e-4464-8a7c-d74b1d1f88ad tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:02.134751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-8711ab8e-451e-4464-8a7c-d74b1d1f88ad tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559" status: 200 len: 1264 microversion: 2.1 time: 0.159513 Aug 28 10:26:02.135314 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 490/997] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:01 2022] GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:03.155921 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f6e7852c-d497-4fa9-8619-a78d8f56797f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:03.157923 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f6e7852c-d497-4fa9-8619-a78d8f56797f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 7745d041-7a19-4bb0-912e-a1f0b361c559] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:03.160228 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:03.161005 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=6 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:03.170377 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f6e7852c-d497-4fa9-8619-a78d8f56797f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:03.171291 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f6e7852c-d497-4fa9-8619-a78d8f56797f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:03.171917 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f6e7852c-d497-4fa9-8619-a78d8f56797f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:03.172824 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f6e7852c-d497-4fa9-8619-a78d8f56797f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:03.173453 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f6e7852c-d497-4fa9-8619-a78d8f56797f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:03.174052 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f6e7852c-d497-4fa9-8619-a78d8f56797f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:03.562045 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f6e7852c-d497-4fa9-8619-a78d8f56797f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:03.570835 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f6e7852c-d497-4fa9-8619-a78d8f56797f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559" status: 200 len: 1264 microversion: 2.1 time: 0.419241 Aug 28 10:26:03.571720 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 508/998] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:03 2022] GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559 => generated 1264 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:04.591731 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-9d42a05b-4eb6-4931-8a9d-afb839f72c8a tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:04.592918 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-9d42a05b-4eb6-4931-8a9d-afb839f72c8a tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 7745d041-7a19-4bb0-912e-a1f0b361c559] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:04.599534 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9d42a05b-4eb6-4931-8a9d-afb839f72c8a tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:04.599938 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9d42a05b-4eb6-4931-8a9d-afb839f72c8a tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:04.600628 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9d42a05b-4eb6-4931-8a9d-afb839f72c8a tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:04.601319 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9d42a05b-4eb6-4931-8a9d-afb839f72c8a tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:04.601755 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9d42a05b-4eb6-4931-8a9d-afb839f72c8a tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:04.602328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9d42a05b-4eb6-4931-8a9d-afb839f72c8a tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:05.057663 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-9d42a05b-4eb6-4931-8a9d-afb839f72c8a tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:05.066074 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-9d42a05b-4eb6-4931-8a9d-afb839f72c8a tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559" status: 200 len: 1264 microversion: 2.1 time: 0.478600 Aug 28 10:26:05.080031 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 491/999] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:04 2022] GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559 => generated 1264 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:05.632165 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-e2b53169-451f-43c1-995c-c6ba1e14c3ee req-37570fad-4f72-41d6-ad90-edf96061c1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7745d041-7a19-4bb0-912e-a1f0b361c559", "name": "network-vif-plugged", "status": "completed", "tag": "4e71047e-d04d-4098-862c-39240d4ddcfc"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:26:05.645975 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:05.650475 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-e2b53169-451f-43c1-995c-c6ba1e14c3ee req-37570fad-4f72-41d6-ad90-edf96061c1d0 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:05.651394 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-e2b53169-451f-43c1-995c-c6ba1e14c3ee req-37570fad-4f72-41d6-ad90-edf96061c1d0 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:05.652051 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-e2b53169-451f-43c1-995c-c6ba1e14c3ee req-37570fad-4f72-41d6-ad90-edf96061c1d0 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:05.670256 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-e2b53169-451f-43c1-995c-c6ba1e14c3ee req-37570fad-4f72-41d6-ad90-edf96061c1d0 service nova] Creating event network-vif-plugged:4e71047e-d04d-4098-862c-39240d4ddcfc for instance 7745d041-7a19-4bb0-912e-a1f0b361c559 on hv-cinder-85200 Aug 28 10:26:05.675584 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-e2b53169-451f-43c1-995c-c6ba1e14c3ee req-37570fad-4f72-41d6-ad90-edf96061c1d0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050615 Aug 28 10:26:05.676611 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 509/1000] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:26:06.088075 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-7807b3d8-7ddd-4e95-848b-cb8041ee6f52 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:06.089496 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-7807b3d8-7ddd-4e95-848b-cb8041ee6f52 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 7745d041-7a19-4bb0-912e-a1f0b361c559] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:06.095074 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:06.097376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7807b3d8-7ddd-4e95-848b-cb8041ee6f52 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:06.098141 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7807b3d8-7ddd-4e95-848b-cb8041ee6f52 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:06.098753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7807b3d8-7ddd-4e95-848b-cb8041ee6f52 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:06.099711 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7807b3d8-7ddd-4e95-848b-cb8041ee6f52 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:06.100467 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7807b3d8-7ddd-4e95-848b-cb8041ee6f52 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:06.101105 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7807b3d8-7ddd-4e95-848b-cb8041ee6f52 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:06.252148 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7807b3d8-7ddd-4e95-848b-cb8041ee6f52 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:06.260965 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-7807b3d8-7ddd-4e95-848b-cb8041ee6f52 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559" status: 200 len: 1264 microversion: 2.1 time: 0.177917 Aug 28 10:26:06.261838 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 492/1001] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:06 2022] GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:07.283499 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5201cdea-55cd-473d-940a-2b7633f1cd55 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:07.284205 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5201cdea-55cd-473d-940a-2b7633f1cd55 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 7745d041-7a19-4bb0-912e-a1f0b361c559] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:07.291174 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5201cdea-55cd-473d-940a-2b7633f1cd55 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:07.291659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5201cdea-55cd-473d-940a-2b7633f1cd55 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:07.292092 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5201cdea-55cd-473d-940a-2b7633f1cd55 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:07.292852 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5201cdea-55cd-473d-940a-2b7633f1cd55 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:07.293760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5201cdea-55cd-473d-940a-2b7633f1cd55 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:07.294180 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5201cdea-55cd-473d-940a-2b7633f1cd55 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:07.474715 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5201cdea-55cd-473d-940a-2b7633f1cd55 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:07.486121 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5201cdea-55cd-473d-940a-2b7633f1cd55 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559" status: 200 len: 1264 microversion: 2.1 time: 0.207188 Aug 28 10:26:07.487550 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 510/1002] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:07 2022] GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559 => generated 1264 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:07.731751 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-6411d37c-1fc5-4450-89dd-fda977256f84 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:07.733235 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-6411d37c-1fc5-4450-89dd-fda977256f84 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:07.741068 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6411d37c-1fc5-4450-89dd-fda977256f84 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:07.741861 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6411d37c-1fc5-4450-89dd-fda977256f84 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:07.742431 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6411d37c-1fc5-4450-89dd-fda977256f84 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:07.743404 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6411d37c-1fc5-4450-89dd-fda977256f84 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:07.744073 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6411d37c-1fc5-4450-89dd-fda977256f84 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:07.744745 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6411d37c-1fc5-4450-89dd-fda977256f84 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:07.777784 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-6411d37c-1fc5-4450-89dd-fda977256f84 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/ips" status: 200 len: 146 microversion: 2.1 time: 0.050939 Aug 28 10:26:07.778534 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 493/1003] 10.222.0.40 () {58 vars in 1248 bytes} [Sun Aug 28 10:26:07 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/ips => generated 146 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:26:08.507597 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-41dcc73a-4f91-4beb-a249-ea69f4fd6464 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:08.508449 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-41dcc73a-4f91-4beb-a249-ea69f4fd6464 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 7745d041-7a19-4bb0-912e-a1f0b361c559] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:08.515770 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41dcc73a-4f91-4beb-a249-ea69f4fd6464 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:08.516492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41dcc73a-4f91-4beb-a249-ea69f4fd6464 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:08.517253 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41dcc73a-4f91-4beb-a249-ea69f4fd6464 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:08.518230 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41dcc73a-4f91-4beb-a249-ea69f4fd6464 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:08.518839 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41dcc73a-4f91-4beb-a249-ea69f4fd6464 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:08.519621 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41dcc73a-4f91-4beb-a249-ea69f4fd6464 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:08.700731 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-41dcc73a-4f91-4beb-a249-ea69f4fd6464 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:08.717115 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-41dcc73a-4f91-4beb-a249-ea69f4fd6464 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559" status: 200 len: 1450 microversion: 2.1 time: 0.213745 Aug 28 10:26:08.719160 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 511/1004] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:08 2022] GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559 => generated 1450 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:08.738900 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-df9c2c60-f09a-447b-b972-e44c27f46cf0 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:08.739418 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-df9c2c60-f09a-447b-b972-e44c27f46cf0 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 7745d041-7a19-4bb0-912e-a1f0b361c559] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:08.747508 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-df9c2c60-f09a-447b-b972-e44c27f46cf0 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:08.748391 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-df9c2c60-f09a-447b-b972-e44c27f46cf0 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:08.749027 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-df9c2c60-f09a-447b-b972-e44c27f46cf0 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:08.749747 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-df9c2c60-f09a-447b-b972-e44c27f46cf0 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:08.750207 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-df9c2c60-f09a-447b-b972-e44c27f46cf0 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:08.754341 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-df9c2c60-f09a-447b-b972-e44c27f46cf0 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:08.902942 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-df9c2c60-f09a-447b-b972-e44c27f46cf0 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:08.912531 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-df9c2c60-f09a-447b-b972-e44c27f46cf0 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559" status: 200 len: 1450 microversion: 2.1 time: 0.177449 Aug 28 10:26:08.913202 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 494/1005] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:08 2022] GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559 => generated 1450 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:09.266467 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f914e8d6-653e-4351-a703-ca9a0afa3eeb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbe49b67-d545-49b6-be1a-ef760c36aa5f"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:26:09.269367 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f914e8d6-653e-4351-a703-ca9a0afa3eeb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:09.277164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f914e8d6-653e-4351-a703-ca9a0afa3eeb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:09.277950 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f914e8d6-653e-4351-a703-ca9a0afa3eeb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:09.279034 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f914e8d6-653e-4351-a703-ca9a0afa3eeb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:09.279937 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f914e8d6-653e-4351-a703-ca9a0afa3eeb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:09.280447 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f914e8d6-653e-4351-a703-ca9a0afa3eeb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:09.280894 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f914e8d6-653e-4351-a703-ca9a0afa3eeb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:09.790976 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f914e8d6-653e-4351-a703-ca9a0afa3eeb tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "POST /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.531154 Aug 28 10:26:09.798212 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 512/1006] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Aug 28 10:26:09 2022] POST /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-volume_attachments => generated 194 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:26:11.395698 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-01963ea8-4477-40ce-9114-90b4056d277a req-d99ad9cc-7e76-49f3-8537-69560029c350 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7745d041-7a19-4bb0-912e-a1f0b361c559", "tag": "4e71047e-d04d-4098-862c-39240d4ddcfc"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:26:11.413576 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-01963ea8-4477-40ce-9114-90b4056d277a req-d99ad9cc-7e76-49f3-8537-69560029c350 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:11.419233 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-01963ea8-4477-40ce-9114-90b4056d277a req-d99ad9cc-7e76-49f3-8537-69560029c350 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:11.421138 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-01963ea8-4477-40ce-9114-90b4056d277a req-d99ad9cc-7e76-49f3-8537-69560029c350 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:11.446974 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-01963ea8-4477-40ce-9114-90b4056d277a req-d99ad9cc-7e76-49f3-8537-69560029c350 service nova] Creating event network-changed:4e71047e-d04d-4098-862c-39240d4ddcfc for instance 7745d041-7a19-4bb0-912e-a1f0b361c559 on hv-cinder-85200 Aug 28 10:26:11.454784 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-01963ea8-4477-40ce-9114-90b4056d277a req-d99ad9cc-7e76-49f3-8537-69560029c350 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063171 Aug 28 10:26:11.456140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 495/1007] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:26:12.160351 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6ae3638a-7f79-4b8b-9fb2-f8edc66248c6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Action: 'create', calling method: .version_select at 0x7f7a1c151940>, body: {"keypair": {"name": "tempest-TestShelveInstance-1279465123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbCfRU8+3eEfdQJxKeZcC7hkChTR42GwXKNX1BJjhywrfHK6cegBXfZFHysgqzZ3zi4meYfNTPsvippieApB8Y5+eIWk1yzWHml3f7Uj6vFTH8Gi4YeS7mE9SDAzzPXQg=="}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:26:12.179256 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-6ae3638a-7f79-4b8b-9fb2-f8edc66248c6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Getting quotas for project 805bd1eda126437d9c2997927d9da8c3. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:26:12.184132 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-6ae3638a-7f79-4b8b-9fb2-f8edc66248c6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Getting quotas for user ec6cbf7f279a4b51994ec4508be71668 and project 805bd1eda126437d9c2997927d9da8c3. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:26:12.222260 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6ae3638a-7f79-4b8b-9fb2-f8edc66248c6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.294339 Aug 28 10:26:12.222887 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 513/1008] 10.222.0.40 () {60 vars in 1159 bytes} [Sun Aug 28 10:26:11 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:26:17.481903 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f426812f-0455-4582-8945-d76b6abb30c1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:17.484149 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f426812f-0455-4582-8945-d76b6abb30c1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:17.490639 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f426812f-0455-4582-8945-d76b6abb30c1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:17.491116 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f426812f-0455-4582-8945-d76b6abb30c1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:17.491548 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f426812f-0455-4582-8945-d76b6abb30c1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:17.492287 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f426812f-0455-4582-8945-d76b6abb30c1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:17.492765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f426812f-0455-4582-8945-d76b6abb30c1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:17.493180 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f426812f-0455-4582-8945-d76b6abb30c1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:17.525454 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f426812f-0455-4582-8945-d76b6abb30c1 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048464 Aug 28 10:26:17.526046 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 496/1009] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Aug 28 10:26:17 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:26:17.537071 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-15d6b9ae-b23a-446f-8269-7dfc49149541 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:17.537687 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-15d6b9ae-b23a-446f-8269-7dfc49149541 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:17.545849 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-15d6b9ae-b23a-446f-8269-7dfc49149541 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:17.546836 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-15d6b9ae-b23a-446f-8269-7dfc49149541 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:17.547756 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-15d6b9ae-b23a-446f-8269-7dfc49149541 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:17.548635 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-15d6b9ae-b23a-446f-8269-7dfc49149541 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:17.549091 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-15d6b9ae-b23a-446f-8269-7dfc49149541 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:17.549544 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-15d6b9ae-b23a-446f-8269-7dfc49149541 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:17.584549 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-15d6b9ae-b23a-446f-8269-7dfc49149541 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-volume_attachments/cbe49b67-d545-49b6-be1a-ef760c36aa5f" status: 200 len: 194 microversion: 2.1 time: 0.051562 Aug 28 10:26:17.585635 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 514/1010] 10.222.0.40 () {58 vars in 1413 bytes} [Sun Aug 28 10:26:17 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-volume_attachments/cbe49b67-d545-49b6-be1a-ef760c36aa5f => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:26:18.938474 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-38be7cfc-7f5f-4d7e-a7a5-7e17b1a11033 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9bf3c35-5f21-4255-8a09-6ed2f2e5f48e"}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:26:18.940890 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-38be7cfc-7f5f-4d7e-a7a5-7e17b1a11033 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:18.947759 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-38be7cfc-7f5f-4d7e-a7a5-7e17b1a11033 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:18.948241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-38be7cfc-7f5f-4d7e-a7a5-7e17b1a11033 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:18.948711 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-38be7cfc-7f5f-4d7e-a7a5-7e17b1a11033 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:18.949407 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-38be7cfc-7f5f-4d7e-a7a5-7e17b1a11033 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:18.949854 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-38be7cfc-7f5f-4d7e-a7a5-7e17b1a11033 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:18.950268 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-38be7cfc-7f5f-4d7e-a7a5-7e17b1a11033 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:19.252645 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-38be7cfc-7f5f-4d7e-a7a5-7e17b1a11033 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "POST /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318513 Aug 28 10:26:19.253288 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 497/1011] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Aug 28 10:26:18 2022] POST /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:26:27.082578 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2e399452-a5c2-4586-ad28-7cef43caf724 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:27.083413 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2e399452-a5c2-4586-ad28-7cef43caf724 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:27.087297 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=4 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:27.094189 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2e399452-a5c2-4586-ad28-7cef43caf724 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:27.094670 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2e399452-a5c2-4586-ad28-7cef43caf724 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:27.095096 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2e399452-a5c2-4586-ad28-7cef43caf724 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:27.095786 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2e399452-a5c2-4586-ad28-7cef43caf724 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:27.096230 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2e399452-a5c2-4586-ad28-7cef43caf724 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:27.096681 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2e399452-a5c2-4586-ad28-7cef43caf724 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:27.099205 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:27.122619 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2e399452-a5c2-4586-ad28-7cef43caf724 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942/ips" status: 200 len: 149 microversion: 2.1 time: 0.046744 Aug 28 10:26:27.123183 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 515/1012] 10.222.0.40 () {58 vars in 1248 bytes} [Sun Aug 28 10:26:27 2022] GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:26:27.889853 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-b3f757fc-0565-4b86-a3cf-f8e5378f0e0d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:27.892189 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-b3f757fc-0565-4b86-a3cf-f8e5378f0e0d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:27.898771 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b3f757fc-0565-4b86-a3cf-f8e5378f0e0d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:27.899281 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b3f757fc-0565-4b86-a3cf-f8e5378f0e0d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:27.899718 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b3f757fc-0565-4b86-a3cf-f8e5378f0e0d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:27.900405 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b3f757fc-0565-4b86-a3cf-f8e5378f0e0d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:27.900882 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b3f757fc-0565-4b86-a3cf-f8e5378f0e0d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:27.901300 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b3f757fc-0565-4b86-a3cf-f8e5378f0e0d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:27.903816 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:27.934569 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-b3f757fc-0565-4b86-a3cf-f8e5378f0e0d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049698 Aug 28 10:26:27.935135 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 498/1013] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Aug 28 10:26:27 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:26:28.083853 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9e0e9fe0-4885-4d3f-8191-818ec8d02a58 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:28.084732 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9e0e9fe0-4885-4d3f-8191-818ec8d02a58 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:28.093541 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e0e9fe0-4885-4d3f-8191-818ec8d02a58 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:28.094015 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e0e9fe0-4885-4d3f-8191-818ec8d02a58 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:28.094436 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e0e9fe0-4885-4d3f-8191-818ec8d02a58 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:28.095113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e0e9fe0-4885-4d3f-8191-818ec8d02a58 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:28.095559 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e0e9fe0-4885-4d3f-8191-818ec8d02a58 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:28.095971 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e0e9fe0-4885-4d3f-8191-818ec8d02a58 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:28.125328 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9e0e9fe0-4885-4d3f-8191-818ec8d02a58 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-volume_attachments/cbe49b67-d545-49b6-be1a-ef760c36aa5f" status: 200 len: 194 microversion: 2.1 time: 0.048457 Aug 28 10:26:28.125898 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 516/1014] 10.222.0.40 () {58 vars in 1413 bytes} [Sun Aug 28 10:26:28 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-volume_attachments/cbe49b67-d545-49b6-be1a-ef760c36aa5f => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:26:28.138368 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-253cc556-018d-446e-9a9f-569466dafd73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:28.138853 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-253cc556-018d-446e-9a9f-569466dafd73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:28.145590 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-253cc556-018d-446e-9a9f-569466dafd73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:28.146104 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-253cc556-018d-446e-9a9f-569466dafd73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:28.146598 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-253cc556-018d-446e-9a9f-569466dafd73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:28.147254 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-253cc556-018d-446e-9a9f-569466dafd73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:28.147702 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-253cc556-018d-446e-9a9f-569466dafd73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:28.148122 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-253cc556-018d-446e-9a9f-569466dafd73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:28.232874 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.objects.instance [None req-253cc556-018d-446e-9a9f-569466dafd73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lazy-loading 'services' on Instance uuid b283b4eb-2390-47c6-8b41-372447998650 {{(pid=120664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:26:28.309030 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-253cc556-018d-446e-9a9f-569466dafd73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-volume_attachments/cbe49b67-d545-49b6-be1a-ef760c36aa5f" status: 202 len: 0 microversion: 2.1 time: 0.176359 Aug 28 10:26:28.309614 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 499/1015] 10.222.0.40 () {58 vars in 1416 bytes} [Sun Aug 28 10:26:28 2022] DELETE /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-volume_attachments/cbe49b67-d545-49b6-be1a-ef760c36aa5f => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:26:28.469484 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9dfdcccb-42ea-45b6-88ca-d0a6d42be686 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe18c47d-8997-48ab-9404-a704ef1ec391"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:26:28.476564 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9dfdcccb-42ea-45b6-88ca-d0a6d42be686 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:28.484672 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9dfdcccb-42ea-45b6-88ca-d0a6d42be686 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:28.485347 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9dfdcccb-42ea-45b6-88ca-d0a6d42be686 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:28.485997 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9dfdcccb-42ea-45b6-88ca-d0a6d42be686 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:28.487026 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9dfdcccb-42ea-45b6-88ca-d0a6d42be686 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:28.487651 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9dfdcccb-42ea-45b6-88ca-d0a6d42be686 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:28.488272 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9dfdcccb-42ea-45b6-88ca-d0a6d42be686 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:29.084426 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9dfdcccb-42ea-45b6-88ca-d0a6d42be686 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "POST /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.618767 Aug 28 10:26:29.085617 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 517/1016] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Aug 28 10:26:28 2022] POST /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942/os-volume_attachments => generated 194 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:26:30.507720 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-973cd7a3-0b89-4652-8008-95ce45773f1f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:30.508467 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-973cd7a3-0b89-4652-8008-95ce45773f1f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:30.515012 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-973cd7a3-0b89-4652-8008-95ce45773f1f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:30.515485 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-973cd7a3-0b89-4652-8008-95ce45773f1f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:30.515936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-973cd7a3-0b89-4652-8008-95ce45773f1f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:30.516634 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-973cd7a3-0b89-4652-8008-95ce45773f1f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:30.517056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-973cd7a3-0b89-4652-8008-95ce45773f1f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:30.517464 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-973cd7a3-0b89-4652-8008-95ce45773f1f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:30.549281 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-973cd7a3-0b89-4652-8008-95ce45773f1f tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-volume_attachments/d9bf3c35-5f21-4255-8a09-6ed2f2e5f48e" status: 200 len: 194 microversion: 2.1 time: 0.046489 Aug 28 10:26:30.549855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 500/1017] 10.222.0.40 () {58 vars in 1413 bytes} [Sun Aug 28 10:26:30 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-volume_attachments/d9bf3c35-5f21-4255-8a09-6ed2f2e5f48e => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:26:30.561774 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dfa7c1d0-2114-4323-8912-5b01e4d0d5f9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:30.562358 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-dfa7c1d0-2114-4323-8912-5b01e4d0d5f9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:30.568939 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfa7c1d0-2114-4323-8912-5b01e4d0d5f9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:30.569418 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfa7c1d0-2114-4323-8912-5b01e4d0d5f9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:30.569844 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfa7c1d0-2114-4323-8912-5b01e4d0d5f9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:30.570533 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfa7c1d0-2114-4323-8912-5b01e4d0d5f9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:30.570977 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfa7c1d0-2114-4323-8912-5b01e4d0d5f9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:30.571391 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfa7c1d0-2114-4323-8912-5b01e4d0d5f9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:30.652823 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-dfa7c1d0-2114-4323-8912-5b01e4d0d5f9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lazy-loading 'services' on Instance uuid b283b4eb-2390-47c6-8b41-372447998650 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:26:30.742810 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-dfa7c1d0-2114-4323-8912-5b01e4d0d5f9 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-volume_attachments/d9bf3c35-5f21-4255-8a09-6ed2f2e5f48e" status: 202 len: 0 microversion: 2.1 time: 0.185852 Aug 28 10:26:30.743621 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 518/1018] 10.222.0.40 () {58 vars in 1416 bytes} [Sun Aug 28 10:26:30 2022] DELETE /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-volume_attachments/d9bf3c35-5f21-4255-8a09-6ed2f2e5f48e => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:26:37.837635 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-08fd83c5-418b-44e5-a35d-2fd11292156a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:37.838215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-08fd83c5-418b-44e5-a35d-2fd11292156a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:37.840649 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=18 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:37.846114 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-08fd83c5-418b-44e5-a35d-2fd11292156a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:37.846594 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-08fd83c5-418b-44e5-a35d-2fd11292156a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:37.847024 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-08fd83c5-418b-44e5-a35d-2fd11292156a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:37.847713 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-08fd83c5-418b-44e5-a35d-2fd11292156a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:37.848163 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-08fd83c5-418b-44e5-a35d-2fd11292156a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:37.848612 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-08fd83c5-418b-44e5-a35d-2fd11292156a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:37.931045 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.objects.instance [None req-08fd83c5-418b-44e5-a35d-2fd11292156a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lazy-loading 'services' on Instance uuid 78ef862a-38f7-47f6-b474-1b997aa89942 {{(pid=120664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:26:38.016721 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-08fd83c5-418b-44e5-a35d-2fd11292156a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "DELETE /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942/os-volume_attachments/fe18c47d-8997-48ab-9404-a704ef1ec391" status: 202 len: 0 microversion: 2.1 time: 0.182907 Aug 28 10:26:38.017333 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 501/1019] 10.222.0.40 () {58 vars in 1416 bytes} [Sun Aug 28 10:26:37 2022] DELETE /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942/os-volume_attachments/fe18c47d-8997-48ab-9404-a704ef1ec391 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:26:38.027177 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8a6a8269-a15f-47b9-9b01-9428623319d9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:38.029543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8a6a8269-a15f-47b9-9b01-9428623319d9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:38.032045 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:38.037922 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a6a8269-a15f-47b9-9b01-9428623319d9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:38.038394 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a6a8269-a15f-47b9-9b01-9428623319d9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:38.038831 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a6a8269-a15f-47b9-9b01-9428623319d9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:38.039477 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a6a8269-a15f-47b9-9b01-9428623319d9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:38.039914 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a6a8269-a15f-47b9-9b01-9428623319d9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:38.040305 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a6a8269-a15f-47b9-9b01-9428623319d9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:38.072882 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8a6a8269-a15f-47b9-9b01-9428623319d9 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050712 Aug 28 10:26:38.073737 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 519/1020] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Aug 28 10:26:38 2022] GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:26:38.191184 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c7154613-1657-4eaa-8708-e5477d6130c8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-452297536", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1279465123", "security_groups": [{"name": "tempest-secgroup-smoke-96847581"}], "networks": [{"uuid": "7b1c0810-ab90-480d-813d-382d387f5767"}], "block_device_mapping_v2": [{"uuid": "cdf9aa6b-1355-4a72-a3f4-a20a9582b085", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:26:38.262618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ac1bfcfb-55ed-446f-98e1-f383ad1583bd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:38.264945 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ac1bfcfb-55ed-446f-98e1-f383ad1583bd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:38.271203 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ac1bfcfb-55ed-446f-98e1-f383ad1583bd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:38.271663 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ac1bfcfb-55ed-446f-98e1-f383ad1583bd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:38.272070 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ac1bfcfb-55ed-446f-98e1-f383ad1583bd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:38.272771 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ac1bfcfb-55ed-446f-98e1-f383ad1583bd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:38.273211 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ac1bfcfb-55ed-446f-98e1-f383ad1583bd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:38.273619 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ac1bfcfb-55ed-446f-98e1-f383ad1583bd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:38.303243 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ac1bfcfb-55ed-446f-98e1-f383ad1583bd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044593 Aug 28 10:26:38.303697 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.network.neutron [None req-c7154613-1657-4eaa-8708-e5477d6130c8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] validate_networks() for [('7b1c0810-ab90-480d-813d-382d387f5767', None, None, None, None, None)] {{(pid=120664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 28 10:26:38.303850 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 520/1021] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Aug 28 10:26:38 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:26:38.695243 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-c7154613-1657-4eaa-8708-e5477d6130c8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Flavor limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 28 10:26:38.695625 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-c7154613-1657-4eaa-8708-e5477d6130c8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Image limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 28 10:26:38.696084 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-c7154613-1657-4eaa-8708-e5477d6130c8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Flavor pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 28 10:26:38.696480 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-c7154613-1657-4eaa-8708-e5477d6130c8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Image pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 28 10:26:38.696899 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-c7154613-1657-4eaa-8708-e5477d6130c8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 28 10:26:38.706106 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c7154613-1657-4eaa-8708-e5477d6130c8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:38.706592 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c7154613-1657-4eaa-8708-e5477d6130c8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:38.707013 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c7154613-1657-4eaa-8708-e5477d6130c8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:38.707718 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c7154613-1657-4eaa-8708-e5477d6130c8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:38.708156 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c7154613-1657-4eaa-8708-e5477d6130c8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:38.708629 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c7154613-1657-4eaa-8708-e5477d6130c8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:38.725447 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-c7154613-1657-4eaa-8708-e5477d6130c8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Getting quotas for project 805bd1eda126437d9c2997927d9da8c3. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:26:38.729683 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-c7154613-1657-4eaa-8708-e5477d6130c8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Getting quotas for user ec6cbf7f279a4b51994ec4508be71668 and project 805bd1eda126437d9c2997927d9da8c3. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:26:38.786839 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c7154613-1657-4eaa-8708-e5477d6130c8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Going to run 1 instances... {{(pid=120664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 28 10:26:38.789081 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c7154613-1657-4eaa-8708-e5477d6130c8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cdf9aa6b-1355-4a72-a3f4-a20a9582b085',volume_size=None,volume_type=None)] {{(pid=120664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 28 10:26:38.930768 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c7154613-1657-4eaa-8708-e5477d6130c8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.743771 Aug 28 10:26:38.931744 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 502/1022] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Aug 28 10:26:38 2022] POST /compute/v2.1/servers => generated 404 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 28 10:26:38.943089 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7e4d9ca2-c463-4159-ab04-685287f429ce tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:38.943673 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7e4d9ca2-c463-4159-ab04-685287f429ce tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:39.004808 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7e4d9ca2-c463-4159-ab04-685287f429ce tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:39.012764 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7e4d9ca2-c463-4159-ab04-685287f429ce tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1088 microversion: 2.1 time: 0.074028 Aug 28 10:26:39.013387 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 521/1023] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:38 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1088 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:39.086063 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-ab3020dd-2400-43d2-ba87-9eecc27e155a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:39.088658 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-ab3020dd-2400-43d2-ba87-9eecc27e155a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:39.095948 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ab3020dd-2400-43d2-ba87-9eecc27e155a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:39.096525 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ab3020dd-2400-43d2-ba87-9eecc27e155a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:39.097028 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ab3020dd-2400-43d2-ba87-9eecc27e155a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:39.097716 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ab3020dd-2400-43d2-ba87-9eecc27e155a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:39.098158 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ab3020dd-2400-43d2-ba87-9eecc27e155a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:39.098574 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ab3020dd-2400-43d2-ba87-9eecc27e155a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:39.128762 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-ab3020dd-2400-43d2-ba87-9eecc27e155a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046910 Aug 28 10:26:39.129401 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 503/1024] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Aug 28 10:26:39 2022] GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 28 10:26:39.192455 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-563b76a8-4233-48a0-8d16-f7319dd17260 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:39.193565 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-563b76a8-4233-48a0-8d16-f7319dd17260 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:39.199490 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-563b76a8-4233-48a0-8d16-f7319dd17260 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:39.199967 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-563b76a8-4233-48a0-8d16-f7319dd17260 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:39.200414 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-563b76a8-4233-48a0-8d16-f7319dd17260 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:39.201131 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-563b76a8-4233-48a0-8d16-f7319dd17260 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:39.201569 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-563b76a8-4233-48a0-8d16-f7319dd17260 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:39.201978 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-563b76a8-4233-48a0-8d16-f7319dd17260 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:39.227427 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-563b76a8-4233-48a0-8d16-f7319dd17260 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 28 10:26:39.307766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-563b76a8-4233-48a0-8d16-f7319dd17260 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "DELETE /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942" status: 204 len: 0 microversion: 2.1 time: 0.118783 Aug 28 10:26:39.308544 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 522/1025] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:26:39 2022] DELETE /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 28 10:26:39.316350 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-a543f44e-d750-4c4e-bffd-2a1cabda8a73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:39.318581 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-a543f44e-d750-4c4e-bffd-2a1cabda8a73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:39.318815 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f6b627ef-99c4-4a5e-8515-73ffa4162682 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:39.320029 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f6b627ef-99c4-4a5e-8515-73ffa4162682 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:39.325793 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a543f44e-d750-4c4e-bffd-2a1cabda8a73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:39.326282 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a543f44e-d750-4c4e-bffd-2a1cabda8a73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:39.326546 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f6b627ef-99c4-4a5e-8515-73ffa4162682 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:39.326685 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a543f44e-d750-4c4e-bffd-2a1cabda8a73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:39.326786 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f6b627ef-99c4-4a5e-8515-73ffa4162682 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:39.327208 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f6b627ef-99c4-4a5e-8515-73ffa4162682 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:39.327398 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a543f44e-d750-4c4e-bffd-2a1cabda8a73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:39.327840 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a543f44e-d750-4c4e-bffd-2a1cabda8a73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:39.327989 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f6b627ef-99c4-4a5e-8515-73ffa4162682 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:39.328254 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a543f44e-d750-4c4e-bffd-2a1cabda8a73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:39.328390 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f6b627ef-99c4-4a5e-8515-73ffa4162682 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:39.328813 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f6b627ef-99c4-4a5e-8515-73ffa4162682 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:39.363428 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-a543f44e-d750-4c4e-bffd-2a1cabda8a73 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051609 Aug 28 10:26:39.364047 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 504/1026] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Aug 28 10:26:39 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 28 10:26:39.470013 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f6b627ef-99c4-4a5e-8515-73ffa4162682 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:39.478078 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f6b627ef-99c4-4a5e-8515-73ffa4162682 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942" status: 200 len: 1680 microversion: 2.1 time: 0.165195 Aug 28 10:26:39.478648 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 523/1027] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:39 2022] GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:39.483035 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-51d47eeb-3a07-4b8f-a256-644d5cbd0c66 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:39.485204 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-51d47eeb-3a07-4b8f-a256-644d5cbd0c66 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:39.491151 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-51d47eeb-3a07-4b8f-a256-644d5cbd0c66 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:39.491622 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-51d47eeb-3a07-4b8f-a256-644d5cbd0c66 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:39.492041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-51d47eeb-3a07-4b8f-a256-644d5cbd0c66 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:39.492740 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-51d47eeb-3a07-4b8f-a256-644d5cbd0c66 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:39.493177 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-51d47eeb-3a07-4b8f-a256-644d5cbd0c66 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:39.493586 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-51d47eeb-3a07-4b8f-a256-644d5cbd0c66 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:39.521812 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-51d47eeb-3a07-4b8f-a256-644d5cbd0c66 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042782 Aug 28 10:26:39.522348 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 505/1028] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Aug 28 10:26:39 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 28 10:26:39.582832 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7fd5bea9-4a74-4aa7-a111-2fa63bf2ac99 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:39.583291 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7fd5bea9-4a74-4aa7-a111-2fa63bf2ac99 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:39.589353 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7fd5bea9-4a74-4aa7-a111-2fa63bf2ac99 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:39.589855 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7fd5bea9-4a74-4aa7-a111-2fa63bf2ac99 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:39.590279 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7fd5bea9-4a74-4aa7-a111-2fa63bf2ac99 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:39.590958 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7fd5bea9-4a74-4aa7-a111-2fa63bf2ac99 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:39.591428 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7fd5bea9-4a74-4aa7-a111-2fa63bf2ac99 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:39.591838 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7fd5bea9-4a74-4aa7-a111-2fa63bf2ac99 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:39.615950 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7fd5bea9-4a74-4aa7-a111-2fa63bf2ac99 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 28 10:26:39.704656 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7fd5bea9-4a74-4aa7-a111-2fa63bf2ac99 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 204 len: 0 microversion: 2.1 time: 0.125382 Aug 28 10:26:39.705173 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 524/1029] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:26:39 2022] DELETE /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 28 10:26:39.713725 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-49647da1-7a05-41fd-bf49-fe32884e770d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:39.714358 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-49647da1-7a05-41fd-bf49-fe32884e770d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:39.720654 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-49647da1-7a05-41fd-bf49-fe32884e770d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:39.721131 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-49647da1-7a05-41fd-bf49-fe32884e770d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:39.721554 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-49647da1-7a05-41fd-bf49-fe32884e770d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:39.722226 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-49647da1-7a05-41fd-bf49-fe32884e770d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:39.722665 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-49647da1-7a05-41fd-bf49-fe32884e770d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:39.723083 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-49647da1-7a05-41fd-bf49-fe32884e770d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:39.854766 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-49647da1-7a05-41fd-bf49-fe32884e770d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:39.866768 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-49647da1-7a05-41fd-bf49-fe32884e770d tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1672 microversion: 2.1 time: 0.156821 Aug 28 10:26:39.867493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 506/1030] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:39 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:40.038152 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5f9d33ed-1851-4b5a-a05f-85358e02402b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:40.039260 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5f9d33ed-1851-4b5a-a05f-85358e02402b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:40.050609 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5f9d33ed-1851-4b5a-a05f-85358e02402b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:40.051390 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5f9d33ed-1851-4b5a-a05f-85358e02402b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:40.052091 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5f9d33ed-1851-4b5a-a05f-85358e02402b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:40.053267 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5f9d33ed-1851-4b5a-a05f-85358e02402b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:40.053995 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5f9d33ed-1851-4b5a-a05f-85358e02402b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:40.054680 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5f9d33ed-1851-4b5a-a05f-85358e02402b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:40.121249 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5f9d33ed-1851-4b5a-a05f-85358e02402b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:40.129040 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5f9d33ed-1851-4b5a-a05f-85358e02402b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1138 microversion: 2.1 time: 0.098288 Aug 28 10:26:40.129607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 525/1031] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:40 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1138 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:40.501510 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e80d7811-82cf-4f98-b823-20aaf7f8b8ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:40.502145 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e80d7811-82cf-4f98-b823-20aaf7f8b8ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:40.509305 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e80d7811-82cf-4f98-b823-20aaf7f8b8ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:40.509805 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e80d7811-82cf-4f98-b823-20aaf7f8b8ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:40.510280 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e80d7811-82cf-4f98-b823-20aaf7f8b8ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:40.510977 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e80d7811-82cf-4f98-b823-20aaf7f8b8ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:40.511472 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e80d7811-82cf-4f98-b823-20aaf7f8b8ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:40.511902 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e80d7811-82cf-4f98-b823-20aaf7f8b8ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:40.650222 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-e80d7811-82cf-4f98-b823-20aaf7f8b8ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:40.658428 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-e80d7811-82cf-4f98-b823-20aaf7f8b8ba tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942" status: 200 len: 1680 microversion: 2.1 time: 0.161586 Aug 28 10:26:40.659036 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 507/1032] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:40 2022] GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:40.894043 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2667ee19-bd02-4455-8991-9e305b2f03cd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:40.895259 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2667ee19-bd02-4455-8991-9e305b2f03cd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:40.905677 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2667ee19-bd02-4455-8991-9e305b2f03cd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:40.906484 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2667ee19-bd02-4455-8991-9e305b2f03cd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:40.907153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2667ee19-bd02-4455-8991-9e305b2f03cd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:40.908385 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2667ee19-bd02-4455-8991-9e305b2f03cd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:40.909186 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2667ee19-bd02-4455-8991-9e305b2f03cd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:40.909910 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2667ee19-bd02-4455-8991-9e305b2f03cd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:41.041371 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2667ee19-bd02-4455-8991-9e305b2f03cd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:41.050235 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2667ee19-bd02-4455-8991-9e305b2f03cd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1672 microversion: 2.1 time: 0.162877 Aug 28 10:26:41.050823 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 526/1033] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:40 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:41.154215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-46898bfd-f3e7-47c3-8d94-dbf4d6717392 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:41.155095 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-46898bfd-f3e7-47c3-8d94-dbf4d6717392 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:41.166048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46898bfd-f3e7-47c3-8d94-dbf4d6717392 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:41.166876 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46898bfd-f3e7-47c3-8d94-dbf4d6717392 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:41.167578 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46898bfd-f3e7-47c3-8d94-dbf4d6717392 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:41.168748 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46898bfd-f3e7-47c3-8d94-dbf4d6717392 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:41.169531 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46898bfd-f3e7-47c3-8d94-dbf4d6717392 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:41.170304 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46898bfd-f3e7-47c3-8d94-dbf4d6717392 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:41.230975 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-46898bfd-f3e7-47c3-8d94-dbf4d6717392 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:41.239021 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-46898bfd-f3e7-47c3-8d94-dbf4d6717392 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1138 microversion: 2.1 time: 0.091476 Aug 28 10:26:41.239591 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 508/1034] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:41 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1138 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:41.684117 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7ad85a5b-7744-417b-9a30-39676ca661cd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:41.685153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7ad85a5b-7744-417b-9a30-39676ca661cd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:41.695242 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ad85a5b-7744-417b-9a30-39676ca661cd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:41.696570 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ad85a5b-7744-417b-9a30-39676ca661cd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:41.697340 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ad85a5b-7744-417b-9a30-39676ca661cd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:41.698491 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ad85a5b-7744-417b-9a30-39676ca661cd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:41.699244 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ad85a5b-7744-417b-9a30-39676ca661cd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:41.699942 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ad85a5b-7744-417b-9a30-39676ca661cd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:41.835268 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7ad85a5b-7744-417b-9a30-39676ca661cd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:41.838939 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:41.848931 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7ad85a5b-7744-417b-9a30-39676ca661cd tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942" status: 200 len: 1680 microversion: 2.1 time: 0.171162 Aug 28 10:26:41.849769 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 527/1035] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:41 2022] GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:42.075365 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-055fc0be-234f-4fa9-8f86-5f6291d096ff tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:42.076300 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-055fc0be-234f-4fa9-8f86-5f6291d096ff tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:42.086561 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-055fc0be-234f-4fa9-8f86-5f6291d096ff tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:42.087251 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-055fc0be-234f-4fa9-8f86-5f6291d096ff tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:42.087967 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-055fc0be-234f-4fa9-8f86-5f6291d096ff tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:42.089141 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-055fc0be-234f-4fa9-8f86-5f6291d096ff tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:42.089884 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-055fc0be-234f-4fa9-8f86-5f6291d096ff tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:42.090590 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-055fc0be-234f-4fa9-8f86-5f6291d096ff tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:42.237809 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-055fc0be-234f-4fa9-8f86-5f6291d096ff tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:42.245743 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-055fc0be-234f-4fa9-8f86-5f6291d096ff tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1672 microversion: 2.1 time: 0.177108 Aug 28 10:26:42.246310 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 509/1036] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:42 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1672 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:42.259873 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7b92c817-9c15-464d-9870-08bda15aaf15 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:42.260481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7b92c817-9c15-464d-9870-08bda15aaf15 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:42.268110 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b92c817-9c15-464d-9870-08bda15aaf15 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:42.268694 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b92c817-9c15-464d-9870-08bda15aaf15 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:42.269124 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b92c817-9c15-464d-9870-08bda15aaf15 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:42.269809 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b92c817-9c15-464d-9870-08bda15aaf15 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:42.270260 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b92c817-9c15-464d-9870-08bda15aaf15 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:42.270673 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b92c817-9c15-464d-9870-08bda15aaf15 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:42.334701 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7b92c817-9c15-464d-9870-08bda15aaf15 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:42.342619 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7b92c817-9c15-464d-9870-08bda15aaf15 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1138 microversion: 2.1 time: 0.087103 Aug 28 10:26:42.343110 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 528/1037] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:42 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1138 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:42.874572 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-1a84c4a6-0043-4335-8168-3e8b76821a7f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:42.875298 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-1a84c4a6-0043-4335-8168-3e8b76821a7f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:42.882563 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1a84c4a6-0043-4335-8168-3e8b76821a7f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:42.883043 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1a84c4a6-0043-4335-8168-3e8b76821a7f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:42.883466 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1a84c4a6-0043-4335-8168-3e8b76821a7f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:42.884160 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1a84c4a6-0043-4335-8168-3e8b76821a7f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:42.884620 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1a84c4a6-0043-4335-8168-3e8b76821a7f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:42.885033 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1a84c4a6-0043-4335-8168-3e8b76821a7f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:43.030065 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-1a84c4a6-0043-4335-8168-3e8b76821a7f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:43.040061 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-1a84c4a6-0043-4335-8168-3e8b76821a7f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942" status: 200 len: 1680 microversion: 2.1 time: 0.170507 Aug 28 10:26:43.041210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 510/1038] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:42 2022] GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:43.267696 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9c49f844-7a85-40c6-a87a-e4b5489e8fec tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:43.268305 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9c49f844-7a85-40c6-a87a-e4b5489e8fec tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:43.275059 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9c49f844-7a85-40c6-a87a-e4b5489e8fec tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:43.275532 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9c49f844-7a85-40c6-a87a-e4b5489e8fec tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:43.275954 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9c49f844-7a85-40c6-a87a-e4b5489e8fec tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:43.276668 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9c49f844-7a85-40c6-a87a-e4b5489e8fec tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:43.277111 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9c49f844-7a85-40c6-a87a-e4b5489e8fec tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:43.277527 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9c49f844-7a85-40c6-a87a-e4b5489e8fec tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:43.365017 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-2a49b732-e17d-4652-b290-d5ffc6bac150 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:43.365673 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-2a49b732-e17d-4652-b290-d5ffc6bac150 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:43.372724 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2a49b732-e17d-4652-b290-d5ffc6bac150 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:43.373207 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2a49b732-e17d-4652-b290-d5ffc6bac150 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:43.373633 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2a49b732-e17d-4652-b290-d5ffc6bac150 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:43.374324 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2a49b732-e17d-4652-b290-d5ffc6bac150 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:43.374938 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2a49b732-e17d-4652-b290-d5ffc6bac150 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:43.375377 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2a49b732-e17d-4652-b290-d5ffc6bac150 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:43.415288 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9c49f844-7a85-40c6-a87a-e4b5489e8fec tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:43.424172 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9c49f844-7a85-40c6-a87a-e4b5489e8fec tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1672 microversion: 2.1 time: 0.160507 Aug 28 10:26:43.436554 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 529/1039] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:43 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1672 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:43.451157 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-2a49b732-e17d-4652-b290-d5ffc6bac150 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:43.459152 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-2a49b732-e17d-4652-b290-d5ffc6bac150 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1186 microversion: 2.1 time: 0.099643 Aug 28 10:26:43.459812 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 511/1040] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:43 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1186 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:44.061807 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f3195316-fa42-48c5-a3e8-c4fbd78d9918 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:44.062409 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f3195316-fa42-48c5-a3e8-c4fbd78d9918 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:44.076432 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3195316-fa42-48c5-a3e8-c4fbd78d9918 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:44.077087 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3195316-fa42-48c5-a3e8-c4fbd78d9918 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:44.077643 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3195316-fa42-48c5-a3e8-c4fbd78d9918 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:44.078350 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3195316-fa42-48c5-a3e8-c4fbd78d9918 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:44.078839 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3195316-fa42-48c5-a3e8-c4fbd78d9918 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:44.079302 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3195316-fa42-48c5-a3e8-c4fbd78d9918 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:44.169426 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f3195316-fa42-48c5-a3e8-c4fbd78d9918 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:44.178635 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f3195316-fa42-48c5-a3e8-c4fbd78d9918 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942" status: 200 len: 1613 microversion: 2.1 time: 0.120734 Aug 28 10:26:44.179560 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 530/1041] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:44 2022] GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 => generated 1613 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:44.449312 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c73fe1ef-534f-47f2-beb9-4e9e58dec23a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:44.450697 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c73fe1ef-534f-47f2-beb9-4e9e58dec23a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:44.470007 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c73fe1ef-534f-47f2-beb9-4e9e58dec23a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:44.470714 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c73fe1ef-534f-47f2-beb9-4e9e58dec23a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:44.471795 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c73fe1ef-534f-47f2-beb9-4e9e58dec23a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:44.474867 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c73fe1ef-534f-47f2-beb9-4e9e58dec23a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:44.475470 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c73fe1ef-534f-47f2-beb9-4e9e58dec23a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:44.478380 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c73fe1ef-534f-47f2-beb9-4e9e58dec23a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:44.484427 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b4aead41-dfb8-4994-9dc8-e8d0ace562d6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:44.485132 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b4aead41-dfb8-4994-9dc8-e8d0ace562d6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:44.495530 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4aead41-dfb8-4994-9dc8-e8d0ace562d6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:44.495937 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4aead41-dfb8-4994-9dc8-e8d0ace562d6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:44.496370 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4aead41-dfb8-4994-9dc8-e8d0ace562d6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:44.497115 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4aead41-dfb8-4994-9dc8-e8d0ace562d6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:44.497567 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4aead41-dfb8-4994-9dc8-e8d0ace562d6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:44.497986 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4aead41-dfb8-4994-9dc8-e8d0ace562d6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:44.741585 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c73fe1ef-534f-47f2-beb9-4e9e58dec23a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:44.759040 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c73fe1ef-534f-47f2-beb9-4e9e58dec23a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1604 microversion: 2.1 time: 0.316943 Aug 28 10:26:44.766250 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 512/1042] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:44 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1604 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:44.772569 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-fa1f1396-ed4f-4e8b-be6d-e0a02389683a req-3f41d406-ceaf-4a10-99e8-12f182fde62a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b283b4eb-2390-47c6-8b41-372447998650", "name": "network-vif-deleted", "tag": "7ed5d47b-49d1-428d-a635-8a4afe3a65e4"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:26:44.830813 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-fa1f1396-ed4f-4e8b-be6d-e0a02389683a req-3f41d406-ceaf-4a10-99e8-12f182fde62a service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:44.833582 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-fa1f1396-ed4f-4e8b-be6d-e0a02389683a req-3f41d406-ceaf-4a10-99e8-12f182fde62a service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:44.834274 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-fa1f1396-ed4f-4e8b-be6d-e0a02389683a req-3f41d406-ceaf-4a10-99e8-12f182fde62a service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:44.851210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-fa1f1396-ed4f-4e8b-be6d-e0a02389683a req-3f41d406-ceaf-4a10-99e8-12f182fde62a service nova] Creating event network-vif-deleted:7ed5d47b-49d1-428d-a635-8a4afe3a65e4 for instance b283b4eb-2390-47c6-8b41-372447998650 on hv-cinder-85200 Aug 28 10:26:44.870230 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-fa1f1396-ed4f-4e8b-be6d-e0a02389683a req-3f41d406-ceaf-4a10-99e8-12f182fde62a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101106 Aug 28 10:26:44.876465 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 513/1043] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:26:44.894190 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b4aead41-dfb8-4994-9dc8-e8d0ace562d6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:44.907644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b4aead41-dfb8-4994-9dc8-e8d0ace562d6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1270 microversion: 2.1 time: 0.432090 Aug 28 10:26:44.908260 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 531/1044] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:44 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1270 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:45.203460 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e0744e77-42e7-4564-8682-f806bb44c6a8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:45.204247 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e0744e77-42e7-4564-8682-f806bb44c6a8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:45.212689 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e0744e77-42e7-4564-8682-f806bb44c6a8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:45.213212 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e0744e77-42e7-4564-8682-f806bb44c6a8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:45.213944 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e0744e77-42e7-4564-8682-f806bb44c6a8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:45.214823 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e0744e77-42e7-4564-8682-f806bb44c6a8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:45.215429 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e0744e77-42e7-4564-8682-f806bb44c6a8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:45.216071 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e0744e77-42e7-4564-8682-f806bb44c6a8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:45.255923 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e0744e77-42e7-4564-8682-f806bb44c6a8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:45.256412 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e0744e77-42e7-4564-8682-f806bb44c6a8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:45.256904 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e0744e77-42e7-4564-8682-f806bb44c6a8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:45.257371 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.objects.instance [None req-e0744e77-42e7-4564-8682-f806bb44c6a8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lazy-loading 'fault' on Instance uuid 78ef862a-38f7-47f6-b474-1b997aa89942 {{(pid=120664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:26:45.262105 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:45.326660 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-e0744e77-42e7-4564-8682-f806bb44c6a8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4711b7691643109007e173fee1c405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefcb341ab8d4823a95c5bce47395083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:45.334586 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-e0744e77-42e7-4564-8682-f806bb44c6a8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942" status: 200 len: 1331 microversion: 2.1 time: 0.136529 Aug 28 10:26:45.335442 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 514/1045] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:45 2022] GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 => generated 1331 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:45.715876 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-cc78f644-05a5-46c0-85d5-ee8fed8f6e56 req-1ea89f00-04fa-4f1f-9679-c00050f2c8fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae", "tag": "39f1800c-cf09-45ec-af04-2a341650fe20"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:26:45.731113 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-cc78f644-05a5-46c0-85d5-ee8fed8f6e56 req-1ea89f00-04fa-4f1f-9679-c00050f2c8fb service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:45.732650 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-cc78f644-05a5-46c0-85d5-ee8fed8f6e56 req-1ea89f00-04fa-4f1f-9679-c00050f2c8fb service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:45.733303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-cc78f644-05a5-46c0-85d5-ee8fed8f6e56 req-1ea89f00-04fa-4f1f-9679-c00050f2c8fb service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:45.750277 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-cc78f644-05a5-46c0-85d5-ee8fed8f6e56 req-1ea89f00-04fa-4f1f-9679-c00050f2c8fb service nova] Creating event network-changed:39f1800c-cf09-45ec-af04-2a341650fe20 for instance 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae on hv-cinder-85200 Aug 28 10:26:45.768992 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-cc78f644-05a5-46c0-85d5-ee8fed8f6e56 req-1ea89f00-04fa-4f1f-9679-c00050f2c8fb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058192 Aug 28 10:26:45.770302 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 532/1046] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:26:45.786652 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-7182fc1a-9111-49ff-b38c-4dbe4d088fbd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:45.787267 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-7182fc1a-9111-49ff-b38c-4dbe4d088fbd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:45.794382 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7182fc1a-9111-49ff-b38c-4dbe4d088fbd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:45.795217 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7182fc1a-9111-49ff-b38c-4dbe4d088fbd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:45.795646 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7182fc1a-9111-49ff-b38c-4dbe4d088fbd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:45.796382 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7182fc1a-9111-49ff-b38c-4dbe4d088fbd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:45.796856 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7182fc1a-9111-49ff-b38c-4dbe4d088fbd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:45.797278 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7182fc1a-9111-49ff-b38c-4dbe4d088fbd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:45.830465 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7182fc1a-9111-49ff-b38c-4dbe4d088fbd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:45.830947 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7182fc1a-9111-49ff-b38c-4dbe4d088fbd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:45.831384 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7182fc1a-9111-49ff-b38c-4dbe4d088fbd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:45.831814 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.objects.instance [None req-7182fc1a-9111-49ff-b38c-4dbe4d088fbd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lazy-loading 'fault' on Instance uuid b283b4eb-2390-47c6-8b41-372447998650 {{(pid=120664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:26:45.884136 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7182fc1a-9111-49ff-b38c-4dbe4d088fbd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a331e431394e4882f31afd31f16d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e47be8f2ac14c19ab40e293422c845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:45.892708 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-7182fc1a-9111-49ff-b38c-4dbe4d088fbd tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 200 len: 1325 microversion: 2.1 time: 0.109911 Aug 28 10:26:45.893698 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 515/1047] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:45 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 1325 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:26:45.936935 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a28d9aa8-cfe9-4a51-a328-5d84bb175b5c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:45.938184 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a28d9aa8-cfe9-4a51-a328-5d84bb175b5c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:45.944987 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a28d9aa8-cfe9-4a51-a328-5d84bb175b5c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:45.945822 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a28d9aa8-cfe9-4a51-a328-5d84bb175b5c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:45.946662 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a28d9aa8-cfe9-4a51-a328-5d84bb175b5c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:45.949165 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a28d9aa8-cfe9-4a51-a328-5d84bb175b5c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:45.949877 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a28d9aa8-cfe9-4a51-a328-5d84bb175b5c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:45.951053 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a28d9aa8-cfe9-4a51-a328-5d84bb175b5c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:46.214623 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a28d9aa8-cfe9-4a51-a328-5d84bb175b5c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:46.228656 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a28d9aa8-cfe9-4a51-a328-5d84bb175b5c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1258 microversion: 2.1 time: 0.297647 Aug 28 10:26:46.243267 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 533/1048] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:45 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1258 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:46.355663 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-3dc3d671-834a-47e3-95f9-244c0103b227 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:46.356397 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-3dc3d671-834a-47e3-95f9-244c0103b227 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:46.363486 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3dc3d671-834a-47e3-95f9-244c0103b227 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:46.363964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3dc3d671-834a-47e3-95f9-244c0103b227 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:46.364414 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3dc3d671-834a-47e3-95f9-244c0103b227 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:46.365161 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3dc3d671-834a-47e3-95f9-244c0103b227 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:46.365738 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3dc3d671-834a-47e3-95f9-244c0103b227 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:46.366274 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3dc3d671-834a-47e3-95f9-244c0103b227 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:46.380837 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-3dc3d671-834a-47e3-95f9-244c0103b227 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] HTTP exception thrown: Instance 78ef862a-38f7-47f6-b474-1b997aa89942 could not be found. Aug 28 10:26:46.382822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-3dc3d671-834a-47e3-95f9-244c0103b227 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Request method failure captured: Aug 28 10:26:46.382822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 HTTP/1.1 Aug 28 10:26:46.382822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:26:46.382822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:26:46.382822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:26:46.382822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:26:46.382822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:26:46.382822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:26:46.382822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:26:46.382822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:26:46.382822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0BavBPfn9Wuv1kO4_4p6KYI6akLuIPAA1OxoMOfBpiurh2AuIBrDxo6hNz9wgslLyVrLvU5C-5Daa9wSWxwGejTKWsNtPvyULf4-HsU7LK2myKRcFzE4k1R7_TjPnuTN-hG4pARjml16ldcyWGxfFf1ULa1aMpcmJVMbJUsqOVrYCU Aug 28 10:26:46.382822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:26:46.382822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:26:46.382822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:26:46.382822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:26:46.382822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:26:46.382822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:26:46.382822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:26:46.382822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:46.382822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:26:46.382822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:26:46.384228 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_eefcb341ab8d4823a95c5bce47395083", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:26:46.384228 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:46.384228 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:26:46.384228 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:46.384228 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:26:46.384228 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:26:46.384228 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:26:46.384228 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: ed4711b7691643109007e173fee1c405 Aug 28 10:26:46.384228 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:26:46.384228 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: > Aug 28 10:26:46.384228 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Instance 78ef862a-38f7-47f6-b474-1b997aa89942 could not be found. Aug 28 10:26:46.384228 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': '78ef862a-38f7-47f6-b474-1b997aa89942'} Aug 28 10:26:46.385067 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:26:46.385067 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:46.385067 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:26:46.385067 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:26:46.385067 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:26:46.385067 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:26:46.385067 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:26:46.385067 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:26:46.385067 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:26:46.385067 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:26:46.385067 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78ef862a-38f7-47f6-b474-1b997aa89942 could not be found. Aug 28 10:26:46.385067 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:46.385067 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:46.385067 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:46.385067 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:46.385067 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:46.385067 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:46.385067 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:26:46.385067 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:26:46.385067 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:26:46.387098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:26:46.387098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:26:46.387098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:26:46.387098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:26:46.387098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:26:46.387098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:26:46.387098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:26:46.387098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78ef862a-38f7-47f6-b474-1b997aa89942 could not be found. Aug 28 10:26:46.387098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:46.387098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:46.387098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:46.387098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:46.387098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:46.387098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:46.387098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:26:46.387098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:26:46.387098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78ef862a-38f7-47f6-b474-1b997aa89942 could not be found. Aug 28 10:26:46.387098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:46.388614 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-3dc3d671-834a-47e3-95f9-244c0103b227 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Returning 404 to user: Instance 78ef862a-38f7-47f6-b474-1b997aa89942 could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:26:46.388614 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-3dc3d671-834a-47e3-95f9-244c0103b227 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942" status: 404 len: 111 microversion: 2.1 time: 0.032795 Aug 28 10:26:46.388614 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 516/1049] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:46 2022] GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 28 10:26:46.394189 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a735740b-3884-48e6-b9ff-1ba6fc419cb8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '.version_select at 0x7f7a1c187700>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:46.422429 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a735740b-3884-48e6-b9ff-1ba6fc419cb8 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-568347225" status: 202 len: 0 microversion: 2.1 time: 0.032203 Aug 28 10:26:46.423036 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 534/1050] 10.222.0.40 () {58 vars in 1218 bytes} [Sun Aug 28 10:26:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-568347225 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:26:46.893483 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-8eeeefc6-5c40-4b61-86cf-58d316e26131 req-6b428962-9a09-4540-8b2c-649430130a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78ef862a-38f7-47f6-b474-1b997aa89942", "name": "network-vif-deleted", "tag": "b98fe54c-b992-4412-a762-eb682c5e50d5"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:26:46.906844 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-8eeeefc6-5c40-4b61-86cf-58d316e26131 req-6b428962-9a09-4540-8b2c-649430130a41 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:46.907324 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-8eeeefc6-5c40-4b61-86cf-58d316e26131 req-6b428962-9a09-4540-8b2c-649430130a41 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:46.907744 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-8eeeefc6-5c40-4b61-86cf-58d316e26131 req-6b428962-9a09-4540-8b2c-649430130a41 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:46.915461 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4dc01094-2be0-4306-8901-384263070a24 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:46.916253 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4dc01094-2be0-4306-8901-384263070a24 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:46.923663 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4dc01094-2be0-4306-8901-384263070a24 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:46.923858 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-8eeeefc6-5c40-4b61-86cf-58d316e26131 req-6b428962-9a09-4540-8b2c-649430130a41 service nova] Creating event network-vif-deleted:b98fe54c-b992-4412-a762-eb682c5e50d5 for instance 78ef862a-38f7-47f6-b474-1b997aa89942 on hv-cinder-85200 Aug 28 10:26:46.924128 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4dc01094-2be0-4306-8901-384263070a24 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:46.924565 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4dc01094-2be0-4306-8901-384263070a24 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:46.925559 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4dc01094-2be0-4306-8901-384263070a24 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:46.926096 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4dc01094-2be0-4306-8901-384263070a24 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:46.926527 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4dc01094-2be0-4306-8901-384263070a24 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:46.928934 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-8eeeefc6-5c40-4b61-86cf-58d316e26131 req-6b428962-9a09-4540-8b2c-649430130a41 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039260 Aug 28 10:26:46.929905 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 517/1051] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:26:46.941628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-4dc01094-2be0-4306-8901-384263070a24 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] HTTP exception thrown: Instance b283b4eb-2390-47c6-8b41-372447998650 could not be found. Aug 28 10:26:46.943481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4dc01094-2be0-4306-8901-384263070a24 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Request method failure captured: Aug 28 10:26:46.943481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 HTTP/1.1 Aug 28 10:26:46.943481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:26:46.943481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:26:46.943481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:26:46.943481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:26:46.943481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:26:46.943481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:26:46.943481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:26:46.943481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:26:46.943481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0DEf1QnaV9IEHCVwJGlLsWAAJdd-9F3vICUaKnR5Mxjlz-BOopu4FhPcKW0_msUYaVCZJ49WxiTbPTr16gC9M0G59NKztvPiIKQ3LlxP6QuusIFut46aa1D7uLslkDID--Y8-1bBPB0b3bzRxoZKRJIunHkfPUzFDPonfMIiEkDvs8 Aug 28 10:26:46.943481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:26:46.943481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:26:46.943481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:26:46.943481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:26:46.943481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:26:46.943481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:26:46.943481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 0e47be8f2ac14c19ab40e293422c845d Aug 28 10:26:46.943481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeTestJSON-219425345 Aug 28 10:26:46.943481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:26:46.943481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:26:46.945022 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0e47be8f2ac14c19ab40e293422c845d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e47be8f2ac14c19ab40e293422c845d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e47be8f2ac14c19ab40e293422c845d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0e47be8f2ac14c19ab40e293422c845d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:26:46.945022 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeTestJSON-219425345 Aug 28 10:26:46.945022 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 0e47be8f2ac14c19ab40e293422c845d Aug 28 10:26:46.945022 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeTestJSON-219425345 Aug 28 10:26:46.945022 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeTestJSON-219425345-project Aug 28 10:26:46.945022 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:26:46.945022 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:26:46.945022 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: 38a331e431394e4882f31afd31f16d46 Aug 28 10:26:46.945022 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeTestJSON-219425345-project Aug 28 10:26:46.945022 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: > Aug 28 10:26:46.945022 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Instance b283b4eb-2390-47c6-8b41-372447998650 could not be found. Aug 28 10:26:46.945022 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'id': 'b283b4eb-2390-47c6-8b41-372447998650'} Aug 28 10:26:46.945818 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:26:46.945818 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:46.945818 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:26:46.945818 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:26:46.945818 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:26:46.945818 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:26:46.945818 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:26:46.945818 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:26:46.945818 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:26:46.945818 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:26:46.945818 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b283b4eb-2390-47c6-8b41-372447998650 could not be found. Aug 28 10:26:46.945818 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:46.945818 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:46.945818 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:46.945818 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:46.945818 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:46.945818 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:46.945818 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:26:46.945818 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:26:46.945818 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:26:46.947785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:26:46.947785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:26:46.947785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:26:46.947785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:26:46.947785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:26:46.947785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:26:46.947785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:26:46.947785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b283b4eb-2390-47c6-8b41-372447998650 could not be found. Aug 28 10:26:46.947785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:46.947785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:46.947785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:46.947785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:46.947785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:46.947785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:46.947785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:26:46.947785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:26:46.947785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b283b4eb-2390-47c6-8b41-372447998650 could not be found. Aug 28 10:26:46.947785 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:46.950034 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4dc01094-2be0-4306-8901-384263070a24 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Returning 404 to user: Instance b283b4eb-2390-47c6-8b41-372447998650 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:26:46.950034 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4dc01094-2be0-4306-8901-384263070a24 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 404 len: 111 microversion: 2.1 time: 0.033883 Aug 28 10:26:46.950034 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 535/1052] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:46 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 28 10:26:46.955505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-5e3419f3-0a86-4323-961f-004d750bf421 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '.version_select at 0x7f7a1c0e0430>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:46.975746 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-5e3419f3-0a86-4323-961f-004d750bf421 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-37251518" status: 202 len: 0 microversion: 2.1 time: 0.024256 Aug 28 10:26:46.976426 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 518/1053] 10.222.0.40 () {58 vars in 1215 bytes} [Sun Aug 28 10:26:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-37251518 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 28 10:26:47.254410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-86afcfe3-5bdf-449a-9125-5a8ead98bb44 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:47.255048 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-86afcfe3-5bdf-449a-9125-5a8ead98bb44 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:47.261176 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86afcfe3-5bdf-449a-9125-5a8ead98bb44 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:47.261660 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86afcfe3-5bdf-449a-9125-5a8ead98bb44 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:47.262083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86afcfe3-5bdf-449a-9125-5a8ead98bb44 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:47.262767 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86afcfe3-5bdf-449a-9125-5a8ead98bb44 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:47.263213 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86afcfe3-5bdf-449a-9125-5a8ead98bb44 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:47.263624 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86afcfe3-5bdf-449a-9125-5a8ead98bb44 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:47.446508 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-731e11db-a616-4924-8e12-7ca480d751e9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:47.448881 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-731e11db-a616-4924-8e12-7ca480d751e9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:47.455971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-731e11db-a616-4924-8e12-7ca480d751e9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:47.456533 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-731e11db-a616-4924-8e12-7ca480d751e9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:47.457052 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-731e11db-a616-4924-8e12-7ca480d751e9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:47.457865 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-731e11db-a616-4924-8e12-7ca480d751e9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:47.458585 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-731e11db-a616-4924-8e12-7ca480d751e9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:47.458994 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-731e11db-a616-4924-8e12-7ca480d751e9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:47.491741 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-731e11db-a616-4924-8e12-7ca480d751e9 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049031 Aug 28 10:26:47.492327 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 519/1054] 10.222.0.40 () {60 vars in 1343 bytes} [Sun Aug 28 10:26:47 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:47.495236 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-86afcfe3-5bdf-449a-9125-5a8ead98bb44 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:47.505122 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-86afcfe3-5bdf-449a-9125-5a8ead98bb44 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1258 microversion: 2.1 time: 0.254570 Aug 28 10:26:47.507019 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 536/1055] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:47 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1258 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:47.580637 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-9ec53c31-d70c-480e-a347-3af9c66eecd7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:47.581698 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-9ec53c31-d70c-480e-a347-3af9c66eecd7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:47.588024 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9ec53c31-d70c-480e-a347-3af9c66eecd7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:47.589196 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9ec53c31-d70c-480e-a347-3af9c66eecd7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:47.589625 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9ec53c31-d70c-480e-a347-3af9c66eecd7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:47.590319 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9ec53c31-d70c-480e-a347-3af9c66eecd7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:47.590756 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9ec53c31-d70c-480e-a347-3af9c66eecd7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:47.591163 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9ec53c31-d70c-480e-a347-3af9c66eecd7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:47.623154 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-9ec53c31-d70c-480e-a347-3af9c66eecd7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Going to try to terminate instance {{(pid=120664) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 28 10:26:47.707606 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-9ec53c31-d70c-480e-a347-3af9c66eecd7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 204 len: 0 microversion: 2.20 time: 0.132434 Aug 28 10:26:47.708740 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 520/1056] 10.222.0.40 () {60 vars in 1280 bytes} [Sun Aug 28 10:26:47 2022] DELETE /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 28 10:26:47.716638 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e3424cbf-1716-43e1-b2f9-4dbbc5d84e72 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:47.717465 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e3424cbf-1716-43e1-b2f9-4dbbc5d84e72 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:47.723902 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e3424cbf-1716-43e1-b2f9-4dbbc5d84e72 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:47.724458 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e3424cbf-1716-43e1-b2f9-4dbbc5d84e72 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:47.724982 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e3424cbf-1716-43e1-b2f9-4dbbc5d84e72 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:47.725745 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e3424cbf-1716-43e1-b2f9-4dbbc5d84e72 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:47.726259 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e3424cbf-1716-43e1-b2f9-4dbbc5d84e72 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:47.726937 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e3424cbf-1716-43e1-b2f9-4dbbc5d84e72 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:47.861440 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e3424cbf-1716-43e1-b2f9-4dbbc5d84e72 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:47.871058 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e3424cbf-1716-43e1-b2f9-4dbbc5d84e72 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:47.872585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e3424cbf-1716-43e1-b2f9-4dbbc5d84e72 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:47.874093 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e3424cbf-1716-43e1-b2f9-4dbbc5d84e72 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1722 microversion: 2.20 time: 0.161351 Aug 28 10:26:47.884642 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 537/1057] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:26:47 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:26:48.246484 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-75063187-4348-47b9-a2e5-9c947bb0808f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:48.247071 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-75063187-4348-47b9-a2e5-9c947bb0808f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:48.253459 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-75063187-4348-47b9-a2e5-9c947bb0808f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:48.253962 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-75063187-4348-47b9-a2e5-9c947bb0808f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:48.254362 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-75063187-4348-47b9-a2e5-9c947bb0808f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:48.255043 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-75063187-4348-47b9-a2e5-9c947bb0808f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:48.255483 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-75063187-4348-47b9-a2e5-9c947bb0808f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:48.255898 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-75063187-4348-47b9-a2e5-9c947bb0808f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:48.269535 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-75063187-4348-47b9-a2e5-9c947bb0808f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] HTTP exception thrown: Instance 78ef862a-38f7-47f6-b474-1b997aa89942 could not be found. Aug 28 10:26:48.271213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-75063187-4348-47b9-a2e5-9c947bb0808f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Request method failure captured: Aug 28 10:26:48.271213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: DELETE /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 HTTP/1.1 Aug 28 10:26:48.271213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:26:48.271213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:26:48.271213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:26:48.271213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:26:48.271213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:26:48.271213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:26:48.271213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:26:48.271213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:26:48.271213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0BavBPfn9Wuv1kO4_4p6KYI6akLuIPAA1OxoMOfBpiurh2AuIBrDxo6hNz9wgslLyVrLvU5C-5Daa9wSWxwGejTKWsNtPvyULf4-HsU7LK2myKRcFzE4k1R7_TjPnuTN-hG4pARjml16ldcyWGxfFf1ULa1aMpcmJVMbJUsqOVrYCU Aug 28 10:26:48.271213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:26:48.271213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:26:48.271213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:26:48.271213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:26:48.271213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:26:48.271213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:26:48.271213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:26:48.271213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:48.271213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:26:48.271213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:26:48.272802 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_eefcb341ab8d4823a95c5bce47395083", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:26:48.272802 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:48.272802 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:26:48.272802 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:48.272802 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:26:48.272802 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:26:48.272802 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:26:48.272802 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: ed4711b7691643109007e173fee1c405 Aug 28 10:26:48.272802 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:26:48.272802 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: > Aug 28 10:26:48.272802 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Instance 78ef862a-38f7-47f6-b474-1b997aa89942 could not be found. Aug 28 10:26:48.272802 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': '78ef862a-38f7-47f6-b474-1b997aa89942'} Aug 28 10:26:48.273541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:26:48.273541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:48.273541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:26:48.273541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:26:48.273541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:26:48.273541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:26:48.273541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:26:48.273541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:26:48.273541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:26:48.273541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:26:48.273541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78ef862a-38f7-47f6-b474-1b997aa89942 could not be found. Aug 28 10:26:48.273541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:48.273541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:48.273541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:48.273541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:48.273541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:48.273541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:48.273541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:26:48.273541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:26:48.273541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:26:48.274851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:26:48.274851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 28 10:26:48.274851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 28 10:26:48.274851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 28 10:26:48.274851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 28 10:26:48.274851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:26:48.274851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:26:48.274851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:26:48.274851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:26:48.274851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78ef862a-38f7-47f6-b474-1b997aa89942 could not be found. Aug 28 10:26:48.274851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:48.274851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:48.274851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:48.274851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:48.274851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:48.274851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:48.274851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:26:48.274851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:26:48.274851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78ef862a-38f7-47f6-b474-1b997aa89942 could not be found. Aug 28 10:26:48.274851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:48.277613 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-75063187-4348-47b9-a2e5-9c947bb0808f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Returning 404 to user: Instance 78ef862a-38f7-47f6-b474-1b997aa89942 could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:26:48.277613 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-75063187-4348-47b9-a2e5-9c947bb0808f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "DELETE /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942" status: 404 len: 111 microversion: 2.1 time: 0.030866 Aug 28 10:26:48.277613 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 521/1058] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:26:48 2022] DELETE /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:26:48.281853 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7a063ef1-ddf0-48f9-a7f8-24c45eee5b98 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:48.282464 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7a063ef1-ddf0-48f9-a7f8-24c45eee5b98 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 78ef862a-38f7-47f6-b474-1b997aa89942] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:48.289457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a063ef1-ddf0-48f9-a7f8-24c45eee5b98 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:48.290024 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a063ef1-ddf0-48f9-a7f8-24c45eee5b98 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:48.290459 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a063ef1-ddf0-48f9-a7f8-24c45eee5b98 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:48.291174 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a063ef1-ddf0-48f9-a7f8-24c45eee5b98 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:48.291624 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a063ef1-ddf0-48f9-a7f8-24c45eee5b98 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:48.292098 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a063ef1-ddf0-48f9-a7f8-24c45eee5b98 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:48.306518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-7a063ef1-ddf0-48f9-a7f8-24c45eee5b98 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] HTTP exception thrown: Instance 78ef862a-38f7-47f6-b474-1b997aa89942 could not be found. Aug 28 10:26:48.308060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7a063ef1-ddf0-48f9-a7f8-24c45eee5b98 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Request method failure captured: Aug 28 10:26:48.308060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 HTTP/1.1 Aug 28 10:26:48.308060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:26:48.308060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:26:48.308060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:26:48.308060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:26:48.308060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:26:48.308060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:26:48.308060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:26:48.308060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:26:48.308060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0BavBPfn9Wuv1kO4_4p6KYI6akLuIPAA1OxoMOfBpiurh2AuIBrDxo6hNz9wgslLyVrLvU5C-5Daa9wSWxwGejTKWsNtPvyULf4-HsU7LK2myKRcFzE4k1R7_TjPnuTN-hG4pARjml16ldcyWGxfFf1ULa1aMpcmJVMbJUsqOVrYCU Aug 28 10:26:48.308060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:26:48.308060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:26:48.308060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:26:48.308060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:26:48.308060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:26:48.308060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:26:48.308060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:26:48.308060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:48.308060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:26:48.308060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:26:48.309835 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_eefcb341ab8d4823a95c5bce47395083", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:26:48.309835 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:48.309835 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:26:48.309835 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:48.309835 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:26:48.309835 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:26:48.309835 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:26:48.309835 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: ed4711b7691643109007e173fee1c405 Aug 28 10:26:48.309835 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:26:48.309835 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: > Aug 28 10:26:48.309835 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Instance 78ef862a-38f7-47f6-b474-1b997aa89942 could not be found. Aug 28 10:26:48.309835 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '78ef862a-38f7-47f6-b474-1b997aa89942'} Aug 28 10:26:48.310728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:26:48.310728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:48.310728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:26:48.310728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:26:48.310728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:26:48.310728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:26:48.310728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:26:48.310728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:26:48.310728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:26:48.310728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:26:48.310728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78ef862a-38f7-47f6-b474-1b997aa89942 could not be found. Aug 28 10:26:48.310728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:48.310728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:48.310728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:48.310728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:48.310728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:48.310728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:48.310728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:26:48.310728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:26:48.310728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:26:48.312185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:26:48.312185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:26:48.312185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:26:48.312185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:26:48.312185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:26:48.312185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:26:48.312185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:26:48.312185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78ef862a-38f7-47f6-b474-1b997aa89942 could not be found. Aug 28 10:26:48.312185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:48.312185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:48.312185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:48.312185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:48.312185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:48.312185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:48.312185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:26:48.312185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:26:48.312185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78ef862a-38f7-47f6-b474-1b997aa89942 could not be found. Aug 28 10:26:48.312185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:48.313651 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7a063ef1-ddf0-48f9-a7f8-24c45eee5b98 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Returning 404 to user: Instance 78ef862a-38f7-47f6-b474-1b997aa89942 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:26:48.313651 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7a063ef1-ddf0-48f9-a7f8-24c45eee5b98 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942" status: 404 len: 111 microversion: 2.1 time: 0.031896 Aug 28 10:26:48.313651 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 538/1059] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:48 2022] GET /compute/v2.1/servers/78ef862a-38f7-47f6-b474-1b997aa89942 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:26:48.534091 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-da24fada-4a14-40e3-b595-ae03df91caf9 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:48.534948 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-da24fada-4a14-40e3-b595-ae03df91caf9 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:48.545527 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-da24fada-4a14-40e3-b595-ae03df91caf9 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:48.546270 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-da24fada-4a14-40e3-b595-ae03df91caf9 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:48.546700 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-da24fada-4a14-40e3-b595-ae03df91caf9 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:48.547400 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-da24fada-4a14-40e3-b595-ae03df91caf9 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:48.547826 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-da24fada-4a14-40e3-b595-ae03df91caf9 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:48.548244 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-da24fada-4a14-40e3-b595-ae03df91caf9 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:48.693385 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-da24fada-4a14-40e3-b595-ae03df91caf9 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:48.701750 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-da24fada-4a14-40e3-b595-ae03df91caf9 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1258 microversion: 2.1 time: 0.174415 Aug 28 10:26:48.702353 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 522/1060] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:48 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1258 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:48.898062 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-51b1bef4-9463-4a2f-a7a6-33d9240571c5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:48.898751 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-51b1bef4-9463-4a2f-a7a6-33d9240571c5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:48.904780 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-51b1bef4-9463-4a2f-a7a6-33d9240571c5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:48.905514 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-51b1bef4-9463-4a2f-a7a6-33d9240571c5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:48.905932 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-51b1bef4-9463-4a2f-a7a6-33d9240571c5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:48.906615 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-51b1bef4-9463-4a2f-a7a6-33d9240571c5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:48.907119 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-51b1bef4-9463-4a2f-a7a6-33d9240571c5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:48.907509 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-51b1bef4-9463-4a2f-a7a6-33d9240571c5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:49.009963 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:49.044053 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-51b1bef4-9463-4a2f-a7a6-33d9240571c5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:49.052602 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-51b1bef4-9463-4a2f-a7a6-33d9240571c5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:49.054276 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-51b1bef4-9463-4a2f-a7a6-33d9240571c5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:49.055474 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-51b1bef4-9463-4a2f-a7a6-33d9240571c5 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1722 microversion: 2.20 time: 0.161637 Aug 28 10:26:49.056010 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 539/1061] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:26:48 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:26:49.450896 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-9ef0aae6-f3e2-49f5-ac82-1cbd950985ad tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:49.451412 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-9ef0aae6-f3e2-49f5-ac82-1cbd950985ad tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:49.453403 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=2 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:49.454050 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=6 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:49.460748 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9ef0aae6-f3e2-49f5-ac82-1cbd950985ad tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:49.461229 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9ef0aae6-f3e2-49f5-ac82-1cbd950985ad tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:49.461659 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9ef0aae6-f3e2-49f5-ac82-1cbd950985ad tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:49.462361 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9ef0aae6-f3e2-49f5-ac82-1cbd950985ad tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:49.462807 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9ef0aae6-f3e2-49f5-ac82-1cbd950985ad tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:49.463214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9ef0aae6-f3e2-49f5-ac82-1cbd950985ad tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:49.477376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-9ef0aae6-f3e2-49f5-ac82-1cbd950985ad tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] HTTP exception thrown: Instance b18b9c06-5718-489a-ab12-86a757322346 could not be found. Aug 28 10:26:49.478945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-9ef0aae6-f3e2-49f5-ac82-1cbd950985ad tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Request method failure captured: Aug 28 10:26:49.478945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: DELETE /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 HTTP/1.1 Aug 28 10:26:49.478945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:26:49.478945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:26:49.478945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:26:49.478945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:26:49.478945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:26:49.478945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:26:49.478945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:26:49.478945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:26:49.478945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0BavBPfn9Wuv1kO4_4p6KYI6akLuIPAA1OxoMOfBpiurh2AuIBrDxo6hNz9wgslLyVrLvU5C-5Daa9wSWxwGejTKWsNtPvyULf4-HsU7LK2myKRcFzE4k1R7_TjPnuTN-hG4pARjml16ldcyWGxfFf1ULa1aMpcmJVMbJUsqOVrYCU Aug 28 10:26:49.478945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:26:49.478945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:26:49.478945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:26:49.478945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:26:49.478945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:26:49.478945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:26:49.478945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:26:49.478945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:49.478945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:26:49.478945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:26:49.480562 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_eefcb341ab8d4823a95c5bce47395083", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:26:49.480562 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:49.480562 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:26:49.480562 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:49.480562 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:26:49.480562 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:26:49.480562 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:26:49.480562 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: ed4711b7691643109007e173fee1c405 Aug 28 10:26:49.480562 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:26:49.480562 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: > Aug 28 10:26:49.480562 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Instance b18b9c06-5718-489a-ab12-86a757322346 could not be found. Aug 28 10:26:49.480562 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': 'b18b9c06-5718-489a-ab12-86a757322346'} Aug 28 10:26:49.481482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:26:49.481482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:49.481482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:26:49.481482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:26:49.481482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:26:49.481482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:26:49.481482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:26:49.481482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:26:49.481482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:26:49.481482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:26:49.481482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b18b9c06-5718-489a-ab12-86a757322346 could not be found. Aug 28 10:26:49.481482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:49.481482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:49.481482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:49.481482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:49.481482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:49.481482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:49.481482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:26:49.481482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:26:49.481482 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:26:49.482976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:26:49.482976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 28 10:26:49.482976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 28 10:26:49.482976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 28 10:26:49.482976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 28 10:26:49.482976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:26:49.482976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:26:49.482976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:26:49.482976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:26:49.482976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b18b9c06-5718-489a-ab12-86a757322346 could not be found. Aug 28 10:26:49.482976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:49.482976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:49.482976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:49.482976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:49.482976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:49.482976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:49.482976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:26:49.482976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:26:49.482976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b18b9c06-5718-489a-ab12-86a757322346 could not be found. Aug 28 10:26:49.482976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:49.484411 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-9ef0aae6-f3e2-49f5-ac82-1cbd950985ad tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Returning 404 to user: Instance b18b9c06-5718-489a-ab12-86a757322346 could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:26:49.484411 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-9ef0aae6-f3e2-49f5-ac82-1cbd950985ad tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 404 len: 111 microversion: 2.1 time: 0.033399 Aug 28 10:26:49.484411 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 523/1062] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:26:49 2022] DELETE /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:26:49.493053 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f4ea650b-7cb2-46aa-8a5a-0bab149f092f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:49.493657 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f4ea650b-7cb2-46aa-8a5a-0bab149f092f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: b18b9c06-5718-489a-ab12-86a757322346] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:49.500430 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4ea650b-7cb2-46aa-8a5a-0bab149f092f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:49.501059 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4ea650b-7cb2-46aa-8a5a-0bab149f092f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:49.501588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4ea650b-7cb2-46aa-8a5a-0bab149f092f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:49.502408 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4ea650b-7cb2-46aa-8a5a-0bab149f092f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:49.503053 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4ea650b-7cb2-46aa-8a5a-0bab149f092f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:49.503477 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4ea650b-7cb2-46aa-8a5a-0bab149f092f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:49.517683 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-f4ea650b-7cb2-46aa-8a5a-0bab149f092f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] HTTP exception thrown: Instance b18b9c06-5718-489a-ab12-86a757322346 could not be found. Aug 28 10:26:49.519158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f4ea650b-7cb2-46aa-8a5a-0bab149f092f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Request method failure captured: Aug 28 10:26:49.519158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 HTTP/1.1 Aug 28 10:26:49.519158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:26:49.519158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:26:49.519158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:26:49.519158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:26:49.519158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:26:49.519158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:26:49.519158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:26:49.519158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:26:49.519158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0BavBPfn9Wuv1kO4_4p6KYI6akLuIPAA1OxoMOfBpiurh2AuIBrDxo6hNz9wgslLyVrLvU5C-5Daa9wSWxwGejTKWsNtPvyULf4-HsU7LK2myKRcFzE4k1R7_TjPnuTN-hG4pARjml16ldcyWGxfFf1ULa1aMpcmJVMbJUsqOVrYCU Aug 28 10:26:49.519158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:26:49.519158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:26:49.519158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:26:49.519158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:26:49.519158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:26:49.519158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:26:49.519158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:26:49.519158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:49.519158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:26:49.519158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:26:49.520759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_eefcb341ab8d4823a95c5bce47395083", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:26:49.520759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:49.520759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:26:49.520759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:49.520759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:26:49.520759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:26:49.520759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:26:49.520759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: ed4711b7691643109007e173fee1c405 Aug 28 10:26:49.520759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:26:49.520759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: > Aug 28 10:26:49.520759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Instance b18b9c06-5718-489a-ab12-86a757322346 could not be found. Aug 28 10:26:49.520759 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'id': 'b18b9c06-5718-489a-ab12-86a757322346'} Aug 28 10:26:49.523520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:26:49.523520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:49.523520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:26:49.523520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:26:49.523520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:26:49.523520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:26:49.523520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:26:49.523520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:26:49.523520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:26:49.523520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:26:49.523520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b18b9c06-5718-489a-ab12-86a757322346 could not be found. Aug 28 10:26:49.523520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:49.523520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:49.523520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:49.523520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:49.523520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:49.523520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:49.523520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:26:49.523520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:26:49.523520 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:26:49.524927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:26:49.524927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:26:49.524927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:26:49.524927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:26:49.524927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:26:49.524927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:26:49.524927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:26:49.524927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b18b9c06-5718-489a-ab12-86a757322346 could not be found. Aug 28 10:26:49.524927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:49.524927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:49.524927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:49.524927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:49.524927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:49.524927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:49.524927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:26:49.524927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:26:49.524927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b18b9c06-5718-489a-ab12-86a757322346 could not be found. Aug 28 10:26:49.524927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:49.526191 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f4ea650b-7cb2-46aa-8a5a-0bab149f092f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Returning 404 to user: Instance b18b9c06-5718-489a-ab12-86a757322346 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:26:49.526191 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f4ea650b-7cb2-46aa-8a5a-0bab149f092f tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346" status: 404 len: 111 microversion: 2.1 time: 0.031659 Aug 28 10:26:49.526191 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 540/1063] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:49 2022] GET /compute/v2.1/servers/b18b9c06-5718-489a-ab12-86a757322346 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:26:49.530098 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-dcb32463-9fc6-4cef-8920-ef7902fe63ed tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:49.530596 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-dcb32463-9fc6-4cef-8920-ef7902fe63ed tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:49.538737 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-dcb32463-9fc6-4cef-8920-ef7902fe63ed tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:49.539221 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-dcb32463-9fc6-4cef-8920-ef7902fe63ed tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:49.539647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-dcb32463-9fc6-4cef-8920-ef7902fe63ed tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:49.540375 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-dcb32463-9fc6-4cef-8920-ef7902fe63ed tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:49.540982 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-dcb32463-9fc6-4cef-8920-ef7902fe63ed tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:49.541397 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-dcb32463-9fc6-4cef-8920-ef7902fe63ed tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:49.556201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-dcb32463-9fc6-4cef-8920-ef7902fe63ed tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] HTTP exception thrown: Instance 109322c8-1668-4c81-bac7-b05bfacf1709 could not be found. Aug 28 10:26:49.557971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-dcb32463-9fc6-4cef-8920-ef7902fe63ed tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Request method failure captured: Aug 28 10:26:49.557971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: DELETE /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 HTTP/1.1 Aug 28 10:26:49.557971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:26:49.557971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:26:49.557971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:26:49.557971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:26:49.557971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:26:49.557971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:26:49.557971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:26:49.557971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:26:49.557971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0BavBPfn9Wuv1kO4_4p6KYI6akLuIPAA1OxoMOfBpiurh2AuIBrDxo6hNz9wgslLyVrLvU5C-5Daa9wSWxwGejTKWsNtPvyULf4-HsU7LK2myKRcFzE4k1R7_TjPnuTN-hG4pARjml16ldcyWGxfFf1ULa1aMpcmJVMbJUsqOVrYCU Aug 28 10:26:49.557971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:26:49.557971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:26:49.557971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:26:49.557971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:26:49.557971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:26:49.557971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:26:49.557971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:26:49.557971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:49.557971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:26:49.557971 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:26:49.559557 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_eefcb341ab8d4823a95c5bce47395083", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:26:49.559557 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:49.559557 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:26:49.559557 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:49.559557 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:26:49.559557 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:26:49.559557 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:26:49.559557 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: ed4711b7691643109007e173fee1c405 Aug 28 10:26:49.559557 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:26:49.559557 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: > Aug 28 10:26:49.559557 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Instance 109322c8-1668-4c81-bac7-b05bfacf1709 could not be found. Aug 28 10:26:49.559557 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': '109322c8-1668-4c81-bac7-b05bfacf1709'} Aug 28 10:26:49.560357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:26:49.560357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:49.560357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:26:49.560357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:26:49.560357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:26:49.560357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:26:49.560357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:26:49.560357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:26:49.560357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:26:49.560357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:26:49.560357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 109322c8-1668-4c81-bac7-b05bfacf1709 could not be found. Aug 28 10:26:49.560357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:49.560357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:49.560357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:49.560357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:49.560357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:49.560357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:49.560357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:26:49.560357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:26:49.560357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:26:49.561603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:26:49.561603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 28 10:26:49.561603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 28 10:26:49.561603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 28 10:26:49.561603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 28 10:26:49.561603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:26:49.561603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:26:49.561603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:26:49.561603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:26:49.561603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 109322c8-1668-4c81-bac7-b05bfacf1709 could not be found. Aug 28 10:26:49.561603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:49.561603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:49.561603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:49.561603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:49.561603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:49.561603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:49.561603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:26:49.561603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:26:49.561603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 109322c8-1668-4c81-bac7-b05bfacf1709 could not be found. Aug 28 10:26:49.561603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:49.562838 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-dcb32463-9fc6-4cef-8920-ef7902fe63ed tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Returning 404 to user: Instance 109322c8-1668-4c81-bac7-b05bfacf1709 could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:26:49.562838 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-dcb32463-9fc6-4cef-8920-ef7902fe63ed tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "DELETE /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 404 len: 111 microversion: 2.1 time: 0.033248 Aug 28 10:26:49.562838 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 524/1064] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:26:49 2022] DELETE /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:26:49.568943 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-64d0212c-63cb-4e0c-a63f-93b62918711a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:49.569606 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-64d0212c-63cb-4e0c-a63f-93b62918711a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: 109322c8-1668-4c81-bac7-b05bfacf1709] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:49.576040 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64d0212c-63cb-4e0c-a63f-93b62918711a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:49.576636 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64d0212c-63cb-4e0c-a63f-93b62918711a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:49.577128 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64d0212c-63cb-4e0c-a63f-93b62918711a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:49.578649 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64d0212c-63cb-4e0c-a63f-93b62918711a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:49.579268 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64d0212c-63cb-4e0c-a63f-93b62918711a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:49.579524 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64d0212c-63cb-4e0c-a63f-93b62918711a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:49.595335 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-64d0212c-63cb-4e0c-a63f-93b62918711a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] HTTP exception thrown: Instance 109322c8-1668-4c81-bac7-b05bfacf1709 could not be found. Aug 28 10:26:49.597182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-64d0212c-63cb-4e0c-a63f-93b62918711a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Request method failure captured: Aug 28 10:26:49.597182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 HTTP/1.1 Aug 28 10:26:49.597182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:26:49.597182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:26:49.597182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:26:49.597182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:26:49.597182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:26:49.597182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:26:49.597182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:26:49.597182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:26:49.597182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0BavBPfn9Wuv1kO4_4p6KYI6akLuIPAA1OxoMOfBpiurh2AuIBrDxo6hNz9wgslLyVrLvU5C-5Daa9wSWxwGejTKWsNtPvyULf4-HsU7LK2myKRcFzE4k1R7_TjPnuTN-hG4pARjml16ldcyWGxfFf1ULa1aMpcmJVMbJUsqOVrYCU Aug 28 10:26:49.597182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:26:49.597182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:26:49.597182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:26:49.597182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:26:49.597182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:26:49.597182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:26:49.597182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:26:49.597182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:49.597182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:26:49.597182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:26:49.598852 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_eefcb341ab8d4823a95c5bce47395083", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:26:49.598852 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:49.598852 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:26:49.598852 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:49.598852 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:26:49.598852 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:26:49.598852 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:26:49.598852 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: ed4711b7691643109007e173fee1c405 Aug 28 10:26:49.598852 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:26:49.598852 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: > Aug 28 10:26:49.598852 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Instance 109322c8-1668-4c81-bac7-b05bfacf1709 could not be found. Aug 28 10:26:49.598852 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '109322c8-1668-4c81-bac7-b05bfacf1709'} Aug 28 10:26:49.599700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:26:49.599700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:49.599700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:26:49.599700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:26:49.599700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:26:49.599700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:26:49.599700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:26:49.599700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:26:49.599700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:26:49.599700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:26:49.599700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 109322c8-1668-4c81-bac7-b05bfacf1709 could not be found. Aug 28 10:26:49.599700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:49.599700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:49.599700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:49.599700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:49.599700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:49.599700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:49.599700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:26:49.599700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:26:49.599700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:26:49.601150 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:26:49.601150 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:26:49.601150 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:26:49.601150 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:26:49.601150 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:26:49.601150 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:26:49.601150 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:26:49.601150 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 109322c8-1668-4c81-bac7-b05bfacf1709 could not be found. Aug 28 10:26:49.601150 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:49.601150 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:49.601150 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:49.601150 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:49.601150 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:49.601150 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:49.601150 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:26:49.601150 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:26:49.601150 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 109322c8-1668-4c81-bac7-b05bfacf1709 could not be found. Aug 28 10:26:49.601150 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:49.602446 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-64d0212c-63cb-4e0c-a63f-93b62918711a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Returning 404 to user: Instance 109322c8-1668-4c81-bac7-b05bfacf1709 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:26:49.602446 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-64d0212c-63cb-4e0c-a63f-93b62918711a tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709" status: 404 len: 111 microversion: 2.1 time: 0.034171 Aug 28 10:26:49.602446 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 541/1065] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:49 2022] GET /compute/v2.1/servers/109322c8-1668-4c81-bac7-b05bfacf1709 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:26:49.726710 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-ecac593b-2abe-4eca-abea-c9d32a7f625b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:49.727314 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-ecac593b-2abe-4eca-abea-c9d32a7f625b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:49.733519 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ecac593b-2abe-4eca-abea-c9d32a7f625b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:49.734001 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ecac593b-2abe-4eca-abea-c9d32a7f625b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:49.734428 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ecac593b-2abe-4eca-abea-c9d32a7f625b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:49.735118 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ecac593b-2abe-4eca-abea-c9d32a7f625b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:49.735628 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ecac593b-2abe-4eca-abea-c9d32a7f625b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:49.736048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ecac593b-2abe-4eca-abea-c9d32a7f625b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:50.023948 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-ecac593b-2abe-4eca-abea-c9d32a7f625b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:50.032048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-ecac593b-2abe-4eca-abea-c9d32a7f625b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1258 microversion: 2.1 time: 0.309283 Aug 28 10:26:50.032826 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 525/1066] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:49 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1258 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:50.065122 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-59cf41fe-5f6f-4dd2-a2c1-fe9aa72e0f58 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:50.065613 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-59cf41fe-5f6f-4dd2-a2c1-fe9aa72e0f58 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:50.071651 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-59cf41fe-5f6f-4dd2-a2c1-fe9aa72e0f58 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:50.072133 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-59cf41fe-5f6f-4dd2-a2c1-fe9aa72e0f58 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:50.072816 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-59cf41fe-5f6f-4dd2-a2c1-fe9aa72e0f58 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:50.073507 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-59cf41fe-5f6f-4dd2-a2c1-fe9aa72e0f58 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:50.074233 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-59cf41fe-5f6f-4dd2-a2c1-fe9aa72e0f58 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:50.074841 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-59cf41fe-5f6f-4dd2-a2c1-fe9aa72e0f58 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:50.080229 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8aaf613a-8450-4edc-b242-84148fe56b35 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:50.080901 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-8aaf613a-8450-4edc-b242-84148fe56b35 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:50.087242 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8aaf613a-8450-4edc-b242-84148fe56b35 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:50.087719 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8aaf613a-8450-4edc-b242-84148fe56b35 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:50.088143 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8aaf613a-8450-4edc-b242-84148fe56b35 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:50.088854 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8aaf613a-8450-4edc-b242-84148fe56b35 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:50.089321 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8aaf613a-8450-4edc-b242-84148fe56b35 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:50.089739 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8aaf613a-8450-4edc-b242-84148fe56b35 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:50.090773 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-59cf41fe-5f6f-4dd2-a2c1-fe9aa72e0f58 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] HTTP exception thrown: Instance b283b4eb-2390-47c6-8b41-372447998650 could not be found. Aug 28 10:26:50.092404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-59cf41fe-5f6f-4dd2-a2c1-fe9aa72e0f58 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Request method failure captured: Aug 28 10:26:50.092404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: DELETE /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 HTTP/1.1 Aug 28 10:26:50.092404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:26:50.092404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:26:50.092404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:26:50.092404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:26:50.092404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:26:50.092404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:26:50.092404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:26:50.092404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:26:50.092404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0DEf1QnaV9IEHCVwJGlLsWAAJdd-9F3vICUaKnR5Mxjlz-BOopu4FhPcKW0_msUYaVCZJ49WxiTbPTr16gC9M0G59NKztvPiIKQ3LlxP6QuusIFut46aa1D7uLslkDID--Y8-1bBPB0b3bzRxoZKRJIunHkfPUzFDPonfMIiEkDvs8 Aug 28 10:26:50.092404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:26:50.092404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:26:50.092404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:26:50.092404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:26:50.092404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:26:50.092404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:26:50.092404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 0e47be8f2ac14c19ab40e293422c845d Aug 28 10:26:50.092404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeTestJSON-219425345 Aug 28 10:26:50.092404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:26:50.092404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:26:50.093855 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0e47be8f2ac14c19ab40e293422c845d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e47be8f2ac14c19ab40e293422c845d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e47be8f2ac14c19ab40e293422c845d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0e47be8f2ac14c19ab40e293422c845d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:26:50.093855 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeTestJSON-219425345 Aug 28 10:26:50.093855 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 0e47be8f2ac14c19ab40e293422c845d Aug 28 10:26:50.093855 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeTestJSON-219425345 Aug 28 10:26:50.093855 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeTestJSON-219425345-project Aug 28 10:26:50.093855 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:26:50.093855 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:26:50.093855 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: 38a331e431394e4882f31afd31f16d46 Aug 28 10:26:50.093855 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeTestJSON-219425345-project Aug 28 10:26:50.093855 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: > Aug 28 10:26:50.093855 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Instance b283b4eb-2390-47c6-8b41-372447998650 could not be found. Aug 28 10:26:50.093855 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'id': 'b283b4eb-2390-47c6-8b41-372447998650'} Aug 28 10:26:50.094754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:26:50.094754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:50.094754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:26:50.094754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:26:50.094754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:26:50.094754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:26:50.094754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:26:50.094754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:26:50.094754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:26:50.094754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:26:50.094754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b283b4eb-2390-47c6-8b41-372447998650 could not be found. Aug 28 10:26:50.094754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:50.094754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:50.094754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:50.094754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:50.094754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:50.094754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:50.094754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:26:50.094754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:26:50.094754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:26:50.096338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:26:50.096338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 28 10:26:50.096338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 28 10:26:50.096338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 28 10:26:50.096338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 28 10:26:50.096338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:26:50.096338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:26:50.096338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:26:50.096338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:26:50.096338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b283b4eb-2390-47c6-8b41-372447998650 could not be found. Aug 28 10:26:50.096338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:50.096338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:50.096338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:50.096338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:50.096338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:50.096338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:50.096338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:26:50.096338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:26:50.096338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b283b4eb-2390-47c6-8b41-372447998650 could not be found. Aug 28 10:26:50.096338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:50.098222 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-59cf41fe-5f6f-4dd2-a2c1-fe9aa72e0f58 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Returning 404 to user: Instance b283b4eb-2390-47c6-8b41-372447998650 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:26:50.098222 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-59cf41fe-5f6f-4dd2-a2c1-fe9aa72e0f58 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 404 len: 111 microversion: 2.1 time: 0.032930 Aug 28 10:26:50.098222 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 542/1067] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:26:50 2022] DELETE /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:26:50.102331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6a71127f-dc93-4baf-8f60-a02d9e4af456 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:50.102964 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6a71127f-dc93-4baf-8f60-a02d9e4af456 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: b283b4eb-2390-47c6-8b41-372447998650] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:50.109007 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a71127f-dc93-4baf-8f60-a02d9e4af456 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:50.109490 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a71127f-dc93-4baf-8f60-a02d9e4af456 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:50.109932 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a71127f-dc93-4baf-8f60-a02d9e4af456 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:50.110647 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a71127f-dc93-4baf-8f60-a02d9e4af456 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:50.111090 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a71127f-dc93-4baf-8f60-a02d9e4af456 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:50.111510 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a71127f-dc93-4baf-8f60-a02d9e4af456 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:50.126614 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-6a71127f-dc93-4baf-8f60-a02d9e4af456 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] HTTP exception thrown: Instance b283b4eb-2390-47c6-8b41-372447998650 could not be found. Aug 28 10:26:50.128179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6a71127f-dc93-4baf-8f60-a02d9e4af456 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Request method failure captured: Aug 28 10:26:50.128179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 HTTP/1.1 Aug 28 10:26:50.128179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:26:50.128179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:26:50.128179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:26:50.128179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:26:50.128179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:26:50.128179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:26:50.128179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:26:50.128179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:26:50.128179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0DEf1QnaV9IEHCVwJGlLsWAAJdd-9F3vICUaKnR5Mxjlz-BOopu4FhPcKW0_msUYaVCZJ49WxiTbPTr16gC9M0G59NKztvPiIKQ3LlxP6QuusIFut46aa1D7uLslkDID--Y8-1bBPB0b3bzRxoZKRJIunHkfPUzFDPonfMIiEkDvs8 Aug 28 10:26:50.128179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:26:50.128179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:26:50.128179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:26:50.128179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:26:50.128179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:26:50.128179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:26:50.128179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 0e47be8f2ac14c19ab40e293422c845d Aug 28 10:26:50.128179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeTestJSON-219425345 Aug 28 10:26:50.128179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:26:50.128179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:26:50.129977 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0e47be8f2ac14c19ab40e293422c845d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e47be8f2ac14c19ab40e293422c845d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e47be8f2ac14c19ab40e293422c845d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0e47be8f2ac14c19ab40e293422c845d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:26:50.129977 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeTestJSON-219425345 Aug 28 10:26:50.129977 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 0e47be8f2ac14c19ab40e293422c845d Aug 28 10:26:50.129977 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeTestJSON-219425345 Aug 28 10:26:50.129977 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeTestJSON-219425345-project Aug 28 10:26:50.129977 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:26:50.129977 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:26:50.129977 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: 38a331e431394e4882f31afd31f16d46 Aug 28 10:26:50.129977 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeTestJSON-219425345-project Aug 28 10:26:50.129977 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: > Aug 28 10:26:50.129977 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Instance b283b4eb-2390-47c6-8b41-372447998650 could not be found. Aug 28 10:26:50.129977 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'id': 'b283b4eb-2390-47c6-8b41-372447998650'} Aug 28 10:26:50.130944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:26:50.130944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:50.130944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:26:50.130944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:26:50.130944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:26:50.130944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:26:50.130944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:26:50.130944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:26:50.130944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:26:50.130944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:26:50.130944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b283b4eb-2390-47c6-8b41-372447998650 could not be found. Aug 28 10:26:50.130944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:50.130944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:50.130944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:50.130944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:50.130944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:50.130944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:50.130944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:26:50.130944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:26:50.130944 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:26:50.132452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:26:50.132452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:26:50.132452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:26:50.132452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:26:50.132452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:26:50.132452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:26:50.132452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:26:50.132452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b283b4eb-2390-47c6-8b41-372447998650 could not be found. Aug 28 10:26:50.132452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:50.132452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:50.132452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:50.132452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:50.132452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:50.132452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:50.132452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:26:50.132452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:26:50.132452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b283b4eb-2390-47c6-8b41-372447998650 could not be found. Aug 28 10:26:50.132452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:50.133957 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6a71127f-dc93-4baf-8f60-a02d9e4af456 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Returning 404 to user: Instance b283b4eb-2390-47c6-8b41-372447998650 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:26:50.133957 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6a71127f-dc93-4baf-8f60-a02d9e4af456 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650" status: 404 len: 111 microversion: 2.1 time: 0.031022 Aug 28 10:26:50.133957 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 543/1068] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:50 2022] GET /compute/v2.1/servers/b283b4eb-2390-47c6-8b41-372447998650 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 28 10:26:50.287651 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8aaf613a-8450-4edc-b242-84148fe56b35 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:50.296666 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8aaf613a-8450-4edc-b242-84148fe56b35 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:50.298201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8aaf613a-8450-4edc-b242-84148fe56b35 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb45c233ca243388bee05dede63415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3dd0514b8542d280fbe2f798714ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:50.299470 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-8aaf613a-8450-4edc-b242-84148fe56b35 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 200 len: 1722 microversion: 2.20 time: 0.223912 Aug 28 10:26:50.300103 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 526/1069] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:26:50 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 28 10:26:50.626253 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-c55db45e-1ed7-4a21-8f99-01493242da55 req-f90b7878-3411-45a8-badf-6d21731c56e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6960433f-4e91-4c5b-9c8e-50645b6e13e7", "name": "network-vif-deleted", "tag": "609522cc-a982-46e3-bc01-474519fee148"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:26:50.636997 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c55db45e-1ed7-4a21-8f99-01493242da55 req-f90b7878-3411-45a8-badf-6d21731c56e7 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:50.637474 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c55db45e-1ed7-4a21-8f99-01493242da55 req-f90b7878-3411-45a8-badf-6d21731c56e7 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:50.638011 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c55db45e-1ed7-4a21-8f99-01493242da55 req-f90b7878-3411-45a8-badf-6d21731c56e7 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:50.650377 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-c55db45e-1ed7-4a21-8f99-01493242da55 req-f90b7878-3411-45a8-badf-6d21731c56e7 service nova] Creating event network-vif-deleted:609522cc-a982-46e3-bc01-474519fee148 for instance 6960433f-4e91-4c5b-9c8e-50645b6e13e7 on hv-cinder-85200 Aug 28 10:26:50.656104 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-c55db45e-1ed7-4a21-8f99-01493242da55 req-f90b7878-3411-45a8-badf-6d21731c56e7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034605 Aug 28 10:26:50.656745 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 544/1070] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:26:50.752887 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-df3cb313-9026-4636-aa23-3530f1c08bd5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:50.753455 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-df3cb313-9026-4636-aa23-3530f1c08bd5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:50.760367 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-df3cb313-9026-4636-aa23-3530f1c08bd5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:50.761173 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-df3cb313-9026-4636-aa23-3530f1c08bd5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:50.761602 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-df3cb313-9026-4636-aa23-3530f1c08bd5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:50.762306 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-df3cb313-9026-4636-aa23-3530f1c08bd5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:50.762744 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-df3cb313-9026-4636-aa23-3530f1c08bd5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:50.763190 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-df3cb313-9026-4636-aa23-3530f1c08bd5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:50.779849 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-df3cb313-9026-4636-aa23-3530f1c08bd5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] HTTP exception thrown: Instance c41bc126-2936-43a3-a819-e9433bb7f8f4 could not be found. Aug 28 10:26:50.782048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-df3cb313-9026-4636-aa23-3530f1c08bd5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Request method failure captured: Aug 28 10:26:50.782048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: DELETE /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 HTTP/1.1 Aug 28 10:26:50.782048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:26:50.782048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:26:50.782048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:26:50.782048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:26:50.782048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:26:50.782048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:26:50.782048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:26:50.782048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:26:50.782048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0BavBPfn9Wuv1kO4_4p6KYI6akLuIPAA1OxoMOfBpiurh2AuIBrDxo6hNz9wgslLyVrLvU5C-5Daa9wSWxwGejTKWsNtPvyULf4-HsU7LK2myKRcFzE4k1R7_TjPnuTN-hG4pARjml16ldcyWGxfFf1ULa1aMpcmJVMbJUsqOVrYCU Aug 28 10:26:50.782048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:26:50.782048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:26:50.782048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:26:50.782048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:26:50.782048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:26:50.782048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:26:50.782048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:26:50.782048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:50.782048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:26:50.782048 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:26:50.783771 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_eefcb341ab8d4823a95c5bce47395083", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:26:50.783771 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:50.783771 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:26:50.783771 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:50.783771 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:26:50.783771 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:26:50.783771 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:26:50.783771 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: ed4711b7691643109007e173fee1c405 Aug 28 10:26:50.783771 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:26:50.783771 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: > Aug 28 10:26:50.783771 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Instance c41bc126-2936-43a3-a819-e9433bb7f8f4 could not be found. Aug 28 10:26:50.783771 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': 'c41bc126-2936-43a3-a819-e9433bb7f8f4'} Aug 28 10:26:50.784729 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:26:50.784729 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:50.784729 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:26:50.784729 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:26:50.784729 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:26:50.784729 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:26:50.784729 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:26:50.784729 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:26:50.784729 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:26:50.784729 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:26:50.784729 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c41bc126-2936-43a3-a819-e9433bb7f8f4 could not be found. Aug 28 10:26:50.784729 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:50.784729 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:50.784729 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:50.784729 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:50.784729 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:50.784729 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:50.784729 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:26:50.784729 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:26:50.784729 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:26:50.786357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:26:50.786357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 28 10:26:50.786357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 28 10:26:50.786357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 28 10:26:50.786357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 28 10:26:50.786357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:26:50.786357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:26:50.786357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:26:50.786357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:26:50.786357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c41bc126-2936-43a3-a819-e9433bb7f8f4 could not be found. Aug 28 10:26:50.786357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:50.786357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:50.786357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:50.786357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:50.786357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:50.786357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:50.786357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:26:50.786357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:26:50.786357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c41bc126-2936-43a3-a819-e9433bb7f8f4 could not be found. Aug 28 10:26:50.786357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:50.789638 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-df3cb313-9026-4636-aa23-3530f1c08bd5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Returning 404 to user: Instance c41bc126-2936-43a3-a819-e9433bb7f8f4 could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:26:50.790505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-df3cb313-9026-4636-aa23-3530f1c08bd5 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 404 len: 111 microversion: 2.1 time: 0.041741 Aug 28 10:26:50.791078 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 527/1071] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:26:50 2022] DELETE /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:26:50.800115 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-964428bd-661e-47bc-9342-5203df13a181 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:50.801104 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-964428bd-661e-47bc-9342-5203df13a181 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] [instance: c41bc126-2936-43a3-a819-e9433bb7f8f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:50.808161 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-964428bd-661e-47bc-9342-5203df13a181 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:50.808809 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-964428bd-661e-47bc-9342-5203df13a181 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:50.809452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-964428bd-661e-47bc-9342-5203df13a181 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:50.810135 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-964428bd-661e-47bc-9342-5203df13a181 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:50.810577 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-964428bd-661e-47bc-9342-5203df13a181 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:50.811011 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-964428bd-661e-47bc-9342-5203df13a181 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:50.827128 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-964428bd-661e-47bc-9342-5203df13a181 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] HTTP exception thrown: Instance c41bc126-2936-43a3-a819-e9433bb7f8f4 could not be found. Aug 28 10:26:50.828920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-964428bd-661e-47bc-9342-5203df13a181 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Request method failure captured: Aug 28 10:26:50.828920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 HTTP/1.1 Aug 28 10:26:50.828920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:26:50.828920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:26:50.828920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:26:50.828920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:26:50.828920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:26:50.828920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:26:50.828920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:26:50.828920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:26:50.828920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0BavBPfn9Wuv1kO4_4p6KYI6akLuIPAA1OxoMOfBpiurh2AuIBrDxo6hNz9wgslLyVrLvU5C-5Daa9wSWxwGejTKWsNtPvyULf4-HsU7LK2myKRcFzE4k1R7_TjPnuTN-hG4pARjml16ldcyWGxfFf1ULa1aMpcmJVMbJUsqOVrYCU Aug 28 10:26:50.828920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:26:50.828920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:26:50.828920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:26:50.828920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:26:50.828920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:26:50.828920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:26:50.828920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:26:50.828920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:50.828920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:26:50.828920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:26:50.830618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_eefcb341ab8d4823a95c5bce47395083", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/eefcb341ab8d4823a95c5bce47395083"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:26:50.830618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:50.830618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: eefcb341ab8d4823a95c5bce47395083 Aug 28 10:26:50.830618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1731370871 Aug 28 10:26:50.830618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:26:50.830618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:26:50.830618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:26:50.830618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: ed4711b7691643109007e173fee1c405 Aug 28 10:26:50.830618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeNegativeTest-1731370871-project Aug 28 10:26:50.830618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: > Aug 28 10:26:50.830618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Instance c41bc126-2936-43a3-a819-e9433bb7f8f4 could not be found. Aug 28 10:26:50.830618 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'id': 'c41bc126-2936-43a3-a819-e9433bb7f8f4'} Aug 28 10:26:50.831518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:26:50.831518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:50.831518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:26:50.831518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:26:50.831518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:26:50.831518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:26:50.831518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:26:50.831518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:26:50.831518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:26:50.831518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:26:50.831518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c41bc126-2936-43a3-a819-e9433bb7f8f4 could not be found. Aug 28 10:26:50.831518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:50.831518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:50.831518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:50.831518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:50.831518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:50.831518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:50.831518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:26:50.831518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:26:50.831518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:26:50.833584 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:26:50.833584 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:26:50.833584 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:26:50.833584 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:26:50.833584 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:26:50.833584 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:26:50.833584 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:26:50.833584 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c41bc126-2936-43a3-a819-e9433bb7f8f4 could not be found. Aug 28 10:26:50.833584 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:50.833584 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:50.833584 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:50.833584 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:50.833584 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:50.833584 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:50.833584 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:26:50.833584 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:26:50.833584 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c41bc126-2936-43a3-a819-e9433bb7f8f4 could not be found. Aug 28 10:26:50.833584 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:50.834671 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-964428bd-661e-47bc-9342-5203df13a181 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] Returning 404 to user: Instance c41bc126-2936-43a3-a819-e9433bb7f8f4 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:26:50.834671 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-964428bd-661e-47bc-9342-5203df13a181 tempest-AttachVolumeNegativeTest-1731370871 tempest-AttachVolumeNegativeTest-1731370871-project] 10.222.0.40 "GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4" status: 404 len: 111 microversion: 2.1 time: 0.035801 Aug 28 10:26:50.834671 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 545/1072] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:50 2022] GET /compute/v2.1/servers/c41bc126-2936-43a3-a819-e9433bb7f8f4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:26:51.054124 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-1525ef5b-a7d9-4b11-ba5c-86b19ea1a0e0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:51.054739 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-1525ef5b-a7d9-4b11-ba5c-86b19ea1a0e0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:51.061550 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1525ef5b-a7d9-4b11-ba5c-86b19ea1a0e0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:51.062030 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1525ef5b-a7d9-4b11-ba5c-86b19ea1a0e0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:51.062656 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1525ef5b-a7d9-4b11-ba5c-86b19ea1a0e0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:51.063569 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1525ef5b-a7d9-4b11-ba5c-86b19ea1a0e0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:51.064049 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1525ef5b-a7d9-4b11-ba5c-86b19ea1a0e0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:51.064480 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1525ef5b-a7d9-4b11-ba5c-86b19ea1a0e0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:51.301898 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c0f74002-f858-41d3-8879-859d5d82603a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:51.302685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c0f74002-f858-41d3-8879-859d5d82603a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:51.311751 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0f74002-f858-41d3-8879-859d5d82603a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:51.312250 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0f74002-f858-41d3-8879-859d5d82603a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:51.312721 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0f74002-f858-41d3-8879-859d5d82603a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:51.313530 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0f74002-f858-41d3-8879-859d5d82603a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:51.313897 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0f74002-f858-41d3-8879-859d5d82603a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:51.314501 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0f74002-f858-41d3-8879-859d5d82603a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:51.332416 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-c0f74002-f858-41d3-8879-859d5d82603a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] HTTP exception thrown: Instance 71cd65ac-3099-4ac7-bf03-ed5173f6204f could not be found. Aug 28 10:26:51.334588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c0f74002-f858-41d3-8879-859d5d82603a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Request method failure captured: Aug 28 10:26:51.334588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: DELETE /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f HTTP/1.1 Aug 28 10:26:51.334588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:26:51.334588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:26:51.334588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:26:51.334588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:26:51.334588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:26:51.334588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:26:51.334588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:26:51.334588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:26:51.334588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0DEf1QnaV9IEHCVwJGlLsWAAJdd-9F3vICUaKnR5Mxjlz-BOopu4FhPcKW0_msUYaVCZJ49WxiTbPTr16gC9M0G59NKztvPiIKQ3LlxP6QuusIFut46aa1D7uLslkDID--Y8-1bBPB0b3bzRxoZKRJIunHkfPUzFDPonfMIiEkDvs8 Aug 28 10:26:51.334588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:26:51.334588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:26:51.334588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:26:51.334588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:26:51.334588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:26:51.334588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:26:51.334588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 0e47be8f2ac14c19ab40e293422c845d Aug 28 10:26:51.334588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeTestJSON-219425345 Aug 28 10:26:51.334588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:26:51.334588 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:26:51.336373 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0e47be8f2ac14c19ab40e293422c845d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e47be8f2ac14c19ab40e293422c845d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e47be8f2ac14c19ab40e293422c845d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0e47be8f2ac14c19ab40e293422c845d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:26:51.336373 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeTestJSON-219425345 Aug 28 10:26:51.336373 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 0e47be8f2ac14c19ab40e293422c845d Aug 28 10:26:51.336373 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeTestJSON-219425345 Aug 28 10:26:51.336373 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeTestJSON-219425345-project Aug 28 10:26:51.336373 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:26:51.336373 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:26:51.336373 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: 38a331e431394e4882f31afd31f16d46 Aug 28 10:26:51.336373 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeTestJSON-219425345-project Aug 28 10:26:51.336373 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: > Aug 28 10:26:51.336373 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Instance 71cd65ac-3099-4ac7-bf03-ed5173f6204f could not be found. Aug 28 10:26:51.336373 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '71cd65ac-3099-4ac7-bf03-ed5173f6204f'} Aug 28 10:26:51.337300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:26:51.337300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:51.337300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:26:51.337300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:26:51.337300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:26:51.337300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:26:51.337300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:26:51.337300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:26:51.337300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:26:51.337300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:26:51.337300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71cd65ac-3099-4ac7-bf03-ed5173f6204f could not be found. Aug 28 10:26:51.337300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:51.337300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:51.337300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:51.337300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:51.337300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:51.337300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:51.337300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:26:51.337300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:26:51.337300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:26:51.338501 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:26:51.338501 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 28 10:26:51.338501 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 28 10:26:51.338501 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 28 10:26:51.338501 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 28 10:26:51.338501 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:26:51.338501 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:26:51.338501 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:26:51.338501 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:26:51.338501 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71cd65ac-3099-4ac7-bf03-ed5173f6204f could not be found. Aug 28 10:26:51.338501 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:51.338501 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:51.338501 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:51.338501 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:51.338501 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:51.338501 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:51.338501 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:26:51.338501 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:26:51.338501 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71cd65ac-3099-4ac7-bf03-ed5173f6204f could not be found. Aug 28 10:26:51.338501 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:51.341565 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c0f74002-f858-41d3-8879-859d5d82603a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Returning 404 to user: Instance 71cd65ac-3099-4ac7-bf03-ed5173f6204f could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:26:51.342973 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c0f74002-f858-41d3-8879-859d5d82603a tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "DELETE /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 404 len: 111 microversion: 2.1 time: 0.045837 Aug 28 10:26:51.343760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 546/1073] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:26:51 2022] DELETE /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:26:51.353435 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b5700cf3-2ad3-42eb-96c8-70be7b621279 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:51.354455 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b5700cf3-2ad3-42eb-96c8-70be7b621279 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:51.362053 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5700cf3-2ad3-42eb-96c8-70be7b621279 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:51.362670 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5700cf3-2ad3-42eb-96c8-70be7b621279 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:51.363196 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5700cf3-2ad3-42eb-96c8-70be7b621279 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:51.364110 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5700cf3-2ad3-42eb-96c8-70be7b621279 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:51.364691 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5700cf3-2ad3-42eb-96c8-70be7b621279 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:51.365206 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5700cf3-2ad3-42eb-96c8-70be7b621279 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:51.379804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-b5700cf3-2ad3-42eb-96c8-70be7b621279 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] HTTP exception thrown: Instance 6960433f-4e91-4c5b-9c8e-50645b6e13e7 could not be found. Aug 28 10:26:51.381547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b5700cf3-2ad3-42eb-96c8-70be7b621279 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Request method failure captured: Aug 28 10:26:51.381547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 HTTP/1.1 Aug 28 10:26:51.381547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:26:51.381547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:26:51.381547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:26:51.381547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:26:51.381547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:26:51.381547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:26:51.381547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:26:51.381547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:26:51.381547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0BX4zckF5W_VQMpQL-Tvj04YthrXksO2vsYw445D5Fb__Du4hoI0szbqm0fbNp_6qriqMbu_Awspp-jUFbNi63humaBrZ-_evOjeeRbH0W0ELM178ttAw6g9QuDkWtqlxSQOMjTjxr8HB1gEyRg-dXxQG9u20cBxz-raM_9AO0-fQY Aug 28 10:26:51.381547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:26:51.381547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:26:51.381547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:26:51.381547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:26:51.381547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Openstack-Nova-Api-Version: 2.20 Aug 28 10:26:51.381547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:26:51.381547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:26:51.381547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 4a3dd0514b8542d280fbe2f798714ea3 Aug 28 10:26:51.381547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-246940552 Aug 28 10:26:51.381547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:26:51.381547 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:26:51.383238 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4a3dd0514b8542d280fbe2f798714ea3", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a3dd0514b8542d280fbe2f798714ea3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a3dd0514b8542d280fbe2f798714ea3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4a3dd0514b8542d280fbe2f798714ea3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:26:51.383238 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeShelveTestJSON-246940552 Aug 28 10:26:51.383238 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 4a3dd0514b8542d280fbe2f798714ea3 Aug 28 10:26:51.383238 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-246940552 Aug 28 10:26:51.383238 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeShelveTestJSON-246940552-project Aug 28 10:26:51.383238 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:26:51.383238 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:26:51.383238 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: 5bb45c233ca243388bee05dede63415f Aug 28 10:26:51.383238 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeShelveTestJSON-246940552-project Aug 28 10:26:51.383238 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: > Aug 28 10:26:51.383238 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Instance 6960433f-4e91-4c5b-9c8e-50645b6e13e7 could not be found. Aug 28 10:26:51.383238 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '6960433f-4e91-4c5b-9c8e-50645b6e13e7'} Aug 28 10:26:51.384151 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:26:51.384151 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:51.384151 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:26:51.384151 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:26:51.384151 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:26:51.384151 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:26:51.384151 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:26:51.384151 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:26:51.384151 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:26:51.384151 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:26:51.384151 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6960433f-4e91-4c5b-9c8e-50645b6e13e7 could not be found. Aug 28 10:26:51.384151 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:51.384151 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:51.384151 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:51.384151 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:51.384151 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:51.384151 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:51.384151 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:26:51.384151 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:26:51.384151 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:26:51.385695 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:26:51.385695 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:26:51.385695 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:26:51.385695 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:26:51.385695 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:26:51.385695 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:26:51.385695 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:26:51.385695 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6960433f-4e91-4c5b-9c8e-50645b6e13e7 could not be found. Aug 28 10:26:51.385695 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:51.385695 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:51.385695 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:51.385695 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:51.385695 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:51.385695 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:51.385695 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:26:51.385695 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:26:51.385695 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6960433f-4e91-4c5b-9c8e-50645b6e13e7 could not be found. Aug 28 10:26:51.385695 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:51.387239 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b5700cf3-2ad3-42eb-96c8-70be7b621279 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Returning 404 to user: Instance 6960433f-4e91-4c5b-9c8e-50645b6e13e7 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:26:51.387239 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b5700cf3-2ad3-42eb-96c8-70be7b621279 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 404 len: 111 microversion: 2.20 time: 0.036268 Aug 28 10:26:51.388577 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 547/1074] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:26:51 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 28 10:26:51.393610 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c9a09676-c7b5-4d43-b4c5-0ab2125b07e0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:51.394215 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c9a09676-c7b5-4d43-b4c5-0ab2125b07e0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] [instance: 71cd65ac-3099-4ac7-bf03-ed5173f6204f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:51.400140 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c9a09676-c7b5-4d43-b4c5-0ab2125b07e0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:51.400753 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c9a09676-c7b5-4d43-b4c5-0ab2125b07e0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:51.401201 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c9a09676-c7b5-4d43-b4c5-0ab2125b07e0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:51.401898 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c9a09676-c7b5-4d43-b4c5-0ab2125b07e0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:51.402344 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c9a09676-c7b5-4d43-b4c5-0ab2125b07e0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:51.402933 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c9a09676-c7b5-4d43-b4c5-0ab2125b07e0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:51.418242 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-c9a09676-c7b5-4d43-b4c5-0ab2125b07e0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] HTTP exception thrown: Instance 71cd65ac-3099-4ac7-bf03-ed5173f6204f could not be found. Aug 28 10:26:51.420153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c9a09676-c7b5-4d43-b4c5-0ab2125b07e0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Request method failure captured: Aug 28 10:26:51.420153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f HTTP/1.1 Aug 28 10:26:51.420153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:26:51.420153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:26:51.420153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:26:51.420153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:26:51.420153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:26:51.420153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:26:51.420153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:26:51.420153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:26:51.420153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0DEf1QnaV9IEHCVwJGlLsWAAJdd-9F3vICUaKnR5Mxjlz-BOopu4FhPcKW0_msUYaVCZJ49WxiTbPTr16gC9M0G59NKztvPiIKQ3LlxP6QuusIFut46aa1D7uLslkDID--Y8-1bBPB0b3bzRxoZKRJIunHkfPUzFDPonfMIiEkDvs8 Aug 28 10:26:51.420153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:26:51.420153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:26:51.420153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:26:51.420153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:26:51.420153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:26:51.420153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:26:51.420153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 0e47be8f2ac14c19ab40e293422c845d Aug 28 10:26:51.420153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeTestJSON-219425345 Aug 28 10:26:51.420153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:26:51.420153 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:26:51.421769 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0e47be8f2ac14c19ab40e293422c845d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e47be8f2ac14c19ab40e293422c845d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e47be8f2ac14c19ab40e293422c845d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0e47be8f2ac14c19ab40e293422c845d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:26:51.421769 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeTestJSON-219425345 Aug 28 10:26:51.421769 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 0e47be8f2ac14c19ab40e293422c845d Aug 28 10:26:51.421769 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeTestJSON-219425345 Aug 28 10:26:51.421769 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeTestJSON-219425345-project Aug 28 10:26:51.421769 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:26:51.421769 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:26:51.421769 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: 38a331e431394e4882f31afd31f16d46 Aug 28 10:26:51.421769 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeTestJSON-219425345-project Aug 28 10:26:51.421769 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: > Aug 28 10:26:51.421769 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Instance 71cd65ac-3099-4ac7-bf03-ed5173f6204f could not be found. Aug 28 10:26:51.421769 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '71cd65ac-3099-4ac7-bf03-ed5173f6204f'} Aug 28 10:26:51.422587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:26:51.422587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:51.422587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:26:51.422587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:26:51.422587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:26:51.422587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:26:51.422587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:26:51.422587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:26:51.422587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:26:51.422587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:26:51.422587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71cd65ac-3099-4ac7-bf03-ed5173f6204f could not be found. Aug 28 10:26:51.422587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:51.422587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:51.422587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:51.422587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:51.422587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:51.422587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:51.422587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:26:51.422587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:26:51.422587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:26:51.424083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:26:51.424083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:26:51.424083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:26:51.424083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:26:51.424083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:26:51.424083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:26:51.424083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:26:51.424083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71cd65ac-3099-4ac7-bf03-ed5173f6204f could not be found. Aug 28 10:26:51.424083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:51.424083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:51.424083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:51.424083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:51.424083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:51.424083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:51.424083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:26:51.424083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:26:51.424083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71cd65ac-3099-4ac7-bf03-ed5173f6204f could not be found. Aug 28 10:26:51.424083 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:51.425315 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c9a09676-c7b5-4d43-b4c5-0ab2125b07e0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] Returning 404 to user: Instance 71cd65ac-3099-4ac7-bf03-ed5173f6204f could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:26:51.425315 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c9a09676-c7b5-4d43-b4c5-0ab2125b07e0 tempest-AttachVolumeTestJSON-219425345 tempest-AttachVolumeTestJSON-219425345-project] 10.222.0.40 "GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f" status: 404 len: 111 microversion: 2.1 time: 0.031880 Aug 28 10:26:51.425315 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 548/1075] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:51 2022] GET /compute/v2.1/servers/71cd65ac-3099-4ac7-bf03-ed5173f6204f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:26:51.427165 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c323dfb6-1355-4498-ba66-c29ae0b4bd24 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '.version_select at 0x7f7a1c1b74c0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:51.459672 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c323dfb6-1355-4498-ba66-c29ae0b4bd24 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-56198054" status: 204 len: 0 microversion: 2.20 time: 0.035925 Aug 28 10:26:51.460953 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 549/1076] 10.222.0.40 () {60 vars in 1256 bytes} [Sun Aug 28 10:26:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-56198054 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 28 10:26:51.494743 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-1525ef5b-a7d9-4b11-ba5c-86b19ea1a0e0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:51.503883 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-1525ef5b-a7d9-4b11-ba5c-86b19ea1a0e0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1258 microversion: 2.1 time: 0.453726 Aug 28 10:26:51.517288 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 528/1077] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:51 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1258 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:52.527744 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ed1f4c14-c159-4b35-915d-8522807ead18 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:52.529150 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ed1f4c14-c159-4b35-915d-8522807ead18 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:52.537888 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed1f4c14-c159-4b35-915d-8522807ead18 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:52.539627 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed1f4c14-c159-4b35-915d-8522807ead18 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:52.540314 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed1f4c14-c159-4b35-915d-8522807ead18 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:52.541340 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed1f4c14-c159-4b35-915d-8522807ead18 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:52.542159 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed1f4c14-c159-4b35-915d-8522807ead18 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:52.542965 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed1f4c14-c159-4b35-915d-8522807ead18 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:52.874669 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ed1f4c14-c159-4b35-915d-8522807ead18 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:52.882888 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ed1f4c14-c159-4b35-915d-8522807ead18 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1258 microversion: 2.1 time: 0.361508 Aug 28 10:26:52.883563 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 550/1078] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:52 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1258 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:53.841566 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e0524fab-8a16-457e-bf55-5faaa1682ea8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:53.842712 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e0524fab-8a16-457e-bf55-5faaa1682ea8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:53.856812 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e0524fab-8a16-457e-bf55-5faaa1682ea8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:53.857560 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e0524fab-8a16-457e-bf55-5faaa1682ea8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:53.858180 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e0524fab-8a16-457e-bf55-5faaa1682ea8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:53.859062 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e0524fab-8a16-457e-bf55-5faaa1682ea8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:53.859499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e0524fab-8a16-457e-bf55-5faaa1682ea8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:53.860117 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e0524fab-8a16-457e-bf55-5faaa1682ea8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:53.890660 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-e0524fab-8a16-457e-bf55-5faaa1682ea8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] HTTP exception thrown: Instance 6960433f-4e91-4c5b-9c8e-50645b6e13e7 could not be found. Aug 28 10:26:53.894770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e0524fab-8a16-457e-bf55-5faaa1682ea8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Request method failure captured: Aug 28 10:26:53.894770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: DELETE /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 HTTP/1.1 Aug 28 10:26:53.894770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:26:53.894770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:26:53.894770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:26:53.894770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:26:53.894770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:26:53.894770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:26:53.894770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:26:53.894770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:26:53.894770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0BX4zckF5W_VQMpQL-Tvj04YthrXksO2vsYw445D5Fb__Du4hoI0szbqm0fbNp_6qriqMbu_Awspp-jUFbNi63humaBrZ-_evOjeeRbH0W0ELM178ttAw6g9QuDkWtqlxSQOMjTjxr8HB1gEyRg-dXxQG9u20cBxz-raM_9AO0-fQY Aug 28 10:26:53.894770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:26:53.894770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:26:53.894770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:26:53.894770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:26:53.894770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Openstack-Nova-Api-Version: 2.20 Aug 28 10:26:53.894770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:26:53.894770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:26:53.894770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: 4a3dd0514b8542d280fbe2f798714ea3 Aug 28 10:26:53.894770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-246940552 Aug 28 10:26:53.894770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:26:53.894770 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:26:53.896433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4a3dd0514b8542d280fbe2f798714ea3", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a3dd0514b8542d280fbe2f798714ea3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a3dd0514b8542d280fbe2f798714ea3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4a3dd0514b8542d280fbe2f798714ea3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:26:53.896433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-AttachVolumeShelveTestJSON-246940552 Aug 28 10:26:53.896433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: 4a3dd0514b8542d280fbe2f798714ea3 Aug 28 10:26:53.896433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-246940552 Aug 28 10:26:53.896433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-AttachVolumeShelveTestJSON-246940552-project Aug 28 10:26:53.896433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:26:53.896433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:26:53.896433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: 5bb45c233ca243388bee05dede63415f Aug 28 10:26:53.896433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-AttachVolumeShelveTestJSON-246940552-project Aug 28 10:26:53.896433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: > Aug 28 10:26:53.896433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Instance 6960433f-4e91-4c5b-9c8e-50645b6e13e7 could not be found. Aug 28 10:26:53.896433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': '6960433f-4e91-4c5b-9c8e-50645b6e13e7'} Aug 28 10:26:53.897201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:26:53.897201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:53.897201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:26:53.897201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:26:53.897201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:26:53.897201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:26:53.897201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:26:53.897201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:26:53.897201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:26:53.897201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:26:53.897201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6960433f-4e91-4c5b-9c8e-50645b6e13e7 could not be found. Aug 28 10:26:53.897201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:53.897201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:53.897201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:53.897201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:53.897201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:53.897201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:53.897201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:26:53.897201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:26:53.897201 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:26:53.899964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:26:53.899964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 28 10:26:53.899964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 28 10:26:53.899964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 28 10:26:53.899964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 28 10:26:53.899964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:26:53.899964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:26:53.899964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:26:53.899964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:26:53.899964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6960433f-4e91-4c5b-9c8e-50645b6e13e7 could not be found. Aug 28 10:26:53.899964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:53.899964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:53.899964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:53.899964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:53.899964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:53.899964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:53.899964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:26:53.899964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:26:53.899964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6960433f-4e91-4c5b-9c8e-50645b6e13e7 could not be found. Aug 28 10:26:53.899964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:53.910448 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0ce7bb3e-f70a-4563-aeea-3bf09d8fe263 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:53.913308 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0ce7bb3e-f70a-4563-aeea-3bf09d8fe263 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:53.922187 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e0524fab-8a16-457e-bf55-5faaa1682ea8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Returning 404 to user: Instance 6960433f-4e91-4c5b-9c8e-50645b6e13e7 could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:26:53.926546 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-e0524fab-8a16-457e-bf55-5faaa1682ea8 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 404 len: 111 microversion: 2.20 time: 0.089650 Aug 28 10:26:53.930561 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 529/1079] 10.222.0.40 () {60 vars in 1280 bytes} [Sun Aug 28 10:26:53 2022] DELETE /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 28 10:26:53.933356 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0ce7bb3e-f70a-4563-aeea-3bf09d8fe263 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:53.933864 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0ce7bb3e-f70a-4563-aeea-3bf09d8fe263 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:53.934297 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0ce7bb3e-f70a-4563-aeea-3bf09d8fe263 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:53.935027 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0ce7bb3e-f70a-4563-aeea-3bf09d8fe263 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:53.935471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0ce7bb3e-f70a-4563-aeea-3bf09d8fe263 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:53.935880 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0ce7bb3e-f70a-4563-aeea-3bf09d8fe263 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:53.943014 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-10f716a4-b5e0-4e10-a88e-8bea7666c547 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:53.943717 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-10f716a4-b5e0-4e10-a88e-8bea7666c547 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 6960433f-4e91-4c5b-9c8e-50645b6e13e7] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:53.957220 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-10f716a4-b5e0-4e10-a88e-8bea7666c547 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:53.959929 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-10f716a4-b5e0-4e10-a88e-8bea7666c547 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:53.963304 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-10f716a4-b5e0-4e10-a88e-8bea7666c547 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:53.966801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-10f716a4-b5e0-4e10-a88e-8bea7666c547 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:53.967872 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-10f716a4-b5e0-4e10-a88e-8bea7666c547 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:53.969641 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-10f716a4-b5e0-4e10-a88e-8bea7666c547 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:54.005535 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-10f716a4-b5e0-4e10-a88e-8bea7666c547 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] HTTP exception thrown: Instance 6960433f-4e91-4c5b-9c8e-50645b6e13e7 could not be found. Aug 28 10:26:54.007505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-10f716a4-b5e0-4e10-a88e-8bea7666c547 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Request method failure captured: Aug 28 10:26:54.007505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 HTTP/1.1 Aug 28 10:26:54.007505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:26:54.007505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:26:54.007505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:26:54.007505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:26:54.007505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:26:54.007505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:26:54.007505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:26:54.007505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:26:54.007505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0BX4zckF5W_VQMpQL-Tvj04YthrXksO2vsYw445D5Fb__Du4hoI0szbqm0fbNp_6qriqMbu_Awspp-jUFbNi63humaBrZ-_evOjeeRbH0W0ELM178ttAw6g9QuDkWtqlxSQOMjTjxr8HB1gEyRg-dXxQG9u20cBxz-raM_9AO0-fQY Aug 28 10:26:54.007505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:26:54.007505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:26:54.007505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:26:54.007505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:26:54.007505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Openstack-Nova-Api-Version: 2.20 Aug 28 10:26:54.007505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:26:54.007505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:26:54.007505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: 4a3dd0514b8542d280fbe2f798714ea3 Aug 28 10:26:54.007505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-246940552 Aug 28 10:26:54.007505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:26:54.007505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:26:54.008942 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4a3dd0514b8542d280fbe2f798714ea3", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a3dd0514b8542d280fbe2f798714ea3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a3dd0514b8542d280fbe2f798714ea3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4a3dd0514b8542d280fbe2f798714ea3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:26:54.008942 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-AttachVolumeShelveTestJSON-246940552 Aug 28 10:26:54.008942 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: 4a3dd0514b8542d280fbe2f798714ea3 Aug 28 10:26:54.008942 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-246940552 Aug 28 10:26:54.008942 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-AttachVolumeShelveTestJSON-246940552-project Aug 28 10:26:54.008942 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:26:54.008942 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:26:54.008942 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: 5bb45c233ca243388bee05dede63415f Aug 28 10:26:54.008942 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-AttachVolumeShelveTestJSON-246940552-project Aug 28 10:26:54.008942 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: > Aug 28 10:26:54.008942 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Instance 6960433f-4e91-4c5b-9c8e-50645b6e13e7 could not be found. Aug 28 10:26:54.008942 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': '6960433f-4e91-4c5b-9c8e-50645b6e13e7'} Aug 28 10:26:54.009895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:26:54.009895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:54.009895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:26:54.009895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:26:54.009895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:26:54.009895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:26:54.009895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:26:54.009895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:26:54.009895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:26:54.009895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:26:54.009895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6960433f-4e91-4c5b-9c8e-50645b6e13e7 could not be found. Aug 28 10:26:54.009895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:54.009895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:54.009895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:54.009895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:54.009895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:54.009895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:54.009895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:26:54.009895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:26:54.009895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:26:54.011144 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:26:54.011144 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:26:54.011144 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:26:54.011144 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:26:54.011144 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:26:54.011144 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:26:54.011144 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:26:54.011144 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6960433f-4e91-4c5b-9c8e-50645b6e13e7 could not be found. Aug 28 10:26:54.011144 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:54.011144 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:54.011144 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:54.011144 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:54.011144 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:54.011144 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:54.011144 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:26:54.011144 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:26:54.011144 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6960433f-4e91-4c5b-9c8e-50645b6e13e7 could not be found. Aug 28 10:26:54.011144 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:54.030494 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-10f716a4-b5e0-4e10-a88e-8bea7666c547 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Returning 404 to user: Instance 6960433f-4e91-4c5b-9c8e-50645b6e13e7 could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:26:54.031361 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-10f716a4-b5e0-4e10-a88e-8bea7666c547 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7" status: 404 len: 111 microversion: 2.20 time: 0.099791 Aug 28 10:26:54.040453 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 530/1080] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:26:53 2022] GET /compute/v2.1/servers/6960433f-4e91-4c5b-9c8e-50645b6e13e7 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 28 10:26:54.286647 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0ce7bb3e-f70a-4563-aeea-3bf09d8fe263 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:54.295478 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0ce7bb3e-f70a-4563-aeea-3bf09d8fe263 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1258 microversion: 2.1 time: 0.392252 Aug 28 10:26:54.296060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 551/1081] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:53 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1258 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:55.207768 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-9aa0a81c-f703-4e0a-9149-eb620c63b8d7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:55.208377 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-9aa0a81c-f703-4e0a-9149-eb620c63b8d7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:55.220129 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9aa0a81c-f703-4e0a-9149-eb620c63b8d7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:55.221030 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9aa0a81c-f703-4e0a-9149-eb620c63b8d7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:55.221690 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9aa0a81c-f703-4e0a-9149-eb620c63b8d7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:55.223117 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9aa0a81c-f703-4e0a-9149-eb620c63b8d7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:55.224445 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9aa0a81c-f703-4e0a-9149-eb620c63b8d7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:55.225160 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9aa0a81c-f703-4e0a-9149-eb620c63b8d7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:55.241601 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-9aa0a81c-f703-4e0a-9149-eb620c63b8d7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] HTTP exception thrown: Instance 2a0819fc-2347-457b-804f-7ef819596193 could not be found. Aug 28 10:26:55.243715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-9aa0a81c-f703-4e0a-9149-eb620c63b8d7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Request method failure captured: Aug 28 10:26:55.243715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: DELETE /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 HTTP/1.1 Aug 28 10:26:55.243715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:26:55.243715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:26:55.243715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:26:55.243715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:26:55.243715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:26:55.243715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:26:55.243715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:26:55.243715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:26:55.243715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0BX4zckF5W_VQMpQL-Tvj04YthrXksO2vsYw445D5Fb__Du4hoI0szbqm0fbNp_6qriqMbu_Awspp-jUFbNi63humaBrZ-_evOjeeRbH0W0ELM178ttAw6g9QuDkWtqlxSQOMjTjxr8HB1gEyRg-dXxQG9u20cBxz-raM_9AO0-fQY Aug 28 10:26:55.243715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:26:55.243715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:26:55.243715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:26:55.243715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:26:55.243715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Openstack-Nova-Api-Version: 2.20 Aug 28 10:26:55.243715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:26:55.243715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:26:55.243715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: 4a3dd0514b8542d280fbe2f798714ea3 Aug 28 10:26:55.243715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-246940552 Aug 28 10:26:55.243715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:26:55.243715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:26:55.245214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4a3dd0514b8542d280fbe2f798714ea3", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a3dd0514b8542d280fbe2f798714ea3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a3dd0514b8542d280fbe2f798714ea3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4a3dd0514b8542d280fbe2f798714ea3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:26:55.245214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-AttachVolumeShelveTestJSON-246940552 Aug 28 10:26:55.245214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: 4a3dd0514b8542d280fbe2f798714ea3 Aug 28 10:26:55.245214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-246940552 Aug 28 10:26:55.245214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-AttachVolumeShelveTestJSON-246940552-project Aug 28 10:26:55.245214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:26:55.245214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:26:55.245214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: 5bb45c233ca243388bee05dede63415f Aug 28 10:26:55.245214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-AttachVolumeShelveTestJSON-246940552-project Aug 28 10:26:55.245214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: > Aug 28 10:26:55.245214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Instance 2a0819fc-2347-457b-804f-7ef819596193 could not be found. Aug 28 10:26:55.245214 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': '2a0819fc-2347-457b-804f-7ef819596193'} Aug 28 10:26:55.245969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:26:55.245969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:55.245969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:26:55.245969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:26:55.245969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:26:55.245969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:26:55.245969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:26:55.245969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:26:55.245969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:26:55.245969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:26:55.245969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a0819fc-2347-457b-804f-7ef819596193 could not be found. Aug 28 10:26:55.245969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:55.245969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:55.245969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:55.245969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:55.245969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:55.245969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:55.245969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:26:55.245969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:26:55.245969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:26:55.247174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:26:55.247174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 28 10:26:55.247174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 28 10:26:55.247174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 28 10:26:55.247174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 28 10:26:55.247174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:26:55.247174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:26:55.247174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:26:55.247174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:26:55.247174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a0819fc-2347-457b-804f-7ef819596193 could not be found. Aug 28 10:26:55.247174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:55.247174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:55.247174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:55.247174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:55.247174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:55.247174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:55.247174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:26:55.247174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:26:55.247174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a0819fc-2347-457b-804f-7ef819596193 could not be found. Aug 28 10:26:55.247174 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:26:55.251396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-9aa0a81c-f703-4e0a-9149-eb620c63b8d7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Returning 404 to user: Instance 2a0819fc-2347-457b-804f-7ef819596193 could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:26:55.252353 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-9aa0a81c-f703-4e0a-9149-eb620c63b8d7 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 404 len: 111 microversion: 2.20 time: 0.048473 Aug 28 10:26:55.254433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 531/1082] 10.222.0.40 () {60 vars in 1280 bytes} [Sun Aug 28 10:26:55 2022] DELETE /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 28 10:26:55.261653 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-956ae77a-1add-44b6-ad0d-4203c1918114 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:55.262994 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-956ae77a-1add-44b6-ad0d-4203c1918114 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] [instance: 2a0819fc-2347-457b-804f-7ef819596193] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:55.276163 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-956ae77a-1add-44b6-ad0d-4203c1918114 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:55.276695 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-956ae77a-1add-44b6-ad0d-4203c1918114 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:55.277351 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-956ae77a-1add-44b6-ad0d-4203c1918114 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:55.278052 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-956ae77a-1add-44b6-ad0d-4203c1918114 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:55.278504 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-956ae77a-1add-44b6-ad0d-4203c1918114 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:55.278922 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-956ae77a-1add-44b6-ad0d-4203c1918114 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:55.294174 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-956ae77a-1add-44b6-ad0d-4203c1918114 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] HTTP exception thrown: Instance 2a0819fc-2347-457b-804f-7ef819596193 could not be found. Aug 28 10:26:55.296398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-956ae77a-1add-44b6-ad0d-4203c1918114 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Request method failure captured: Aug 28 10:26:55.296398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 HTTP/1.1 Aug 28 10:26:55.296398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:26:55.296398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:26:55.296398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:26:55.296398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:26:55.296398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:26:55.296398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:26:55.296398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:26:55.296398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:26:55.296398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0BX4zckF5W_VQMpQL-Tvj04YthrXksO2vsYw445D5Fb__Du4hoI0szbqm0fbNp_6qriqMbu_Awspp-jUFbNi63humaBrZ-_evOjeeRbH0W0ELM178ttAw6g9QuDkWtqlxSQOMjTjxr8HB1gEyRg-dXxQG9u20cBxz-raM_9AO0-fQY Aug 28 10:26:55.296398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:26:55.296398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:26:55.296398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:26:55.296398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:26:55.296398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Openstack-Nova-Api-Version: 2.20 Aug 28 10:26:55.296398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:26:55.296398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:26:55.296398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 4a3dd0514b8542d280fbe2f798714ea3 Aug 28 10:26:55.296398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-246940552 Aug 28 10:26:55.296398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:26:55.296398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:26:55.297898 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4a3dd0514b8542d280fbe2f798714ea3", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a3dd0514b8542d280fbe2f798714ea3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a3dd0514b8542d280fbe2f798714ea3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4a3dd0514b8542d280fbe2f798714ea3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:26:55.297898 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeShelveTestJSON-246940552 Aug 28 10:26:55.297898 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 4a3dd0514b8542d280fbe2f798714ea3 Aug 28 10:26:55.297898 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-246940552 Aug 28 10:26:55.297898 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeShelveTestJSON-246940552-project Aug 28 10:26:55.297898 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:26:55.297898 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:26:55.297898 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: 5bb45c233ca243388bee05dede63415f Aug 28 10:26:55.297898 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeShelveTestJSON-246940552-project Aug 28 10:26:55.297898 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: > Aug 28 10:26:55.297898 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Instance 2a0819fc-2347-457b-804f-7ef819596193 could not be found. Aug 28 10:26:55.297898 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '2a0819fc-2347-457b-804f-7ef819596193'} Aug 28 10:26:55.298659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:26:55.298659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:55.298659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:26:55.298659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:26:55.298659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:26:55.298659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:26:55.298659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:26:55.298659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:26:55.298659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:26:55.298659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:26:55.298659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a0819fc-2347-457b-804f-7ef819596193 could not be found. Aug 28 10:26:55.298659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:55.298659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:55.298659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:55.298659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:55.298659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:55.298659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:55.298659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:26:55.298659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:26:55.298659 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:26:55.300303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:26:55.300303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:26:55.300303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:26:55.300303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:26:55.300303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:26:55.300303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:26:55.300303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:26:55.300303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a0819fc-2347-457b-804f-7ef819596193 could not be found. Aug 28 10:26:55.300303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:55.300303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:26:55.300303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:55.300303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:26:55.300303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:26:55.300303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:26:55.300303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:26:55.300303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:26:55.300303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a0819fc-2347-457b-804f-7ef819596193 could not be found. Aug 28 10:26:55.300303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:26:55.303505 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-956ae77a-1add-44b6-ad0d-4203c1918114 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] Returning 404 to user: Instance 2a0819fc-2347-457b-804f-7ef819596193 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:26:55.304585 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-956ae77a-1add-44b6-ad0d-4203c1918114 tempest-AttachVolumeShelveTestJSON-246940552 tempest-AttachVolumeShelveTestJSON-246940552-project] 10.222.0.40 "GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193" status: 404 len: 111 microversion: 2.20 time: 0.046894 Aug 28 10:26:55.305359 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 552/1083] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Aug 28 10:26:55 2022] GET /compute/v2.1/servers/2a0819fc-2347-457b-804f-7ef819596193 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 28 10:26:55.315407 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-25b57b8a-c722-4090-aa1c-53d6a5fa211c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:55.316097 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-25b57b8a-c722-4090-aa1c-53d6a5fa211c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:55.331429 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-25b57b8a-c722-4090-aa1c-53d6a5fa211c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:55.332012 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-25b57b8a-c722-4090-aa1c-53d6a5fa211c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:55.332464 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-25b57b8a-c722-4090-aa1c-53d6a5fa211c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:55.333430 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-25b57b8a-c722-4090-aa1c-53d6a5fa211c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:55.333816 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-25b57b8a-c722-4090-aa1c-53d6a5fa211c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:55.334291 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-25b57b8a-c722-4090-aa1c-53d6a5fa211c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:55.953254 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-25b57b8a-c722-4090-aa1c-53d6a5fa211c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:55.963433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-25b57b8a-c722-4090-aa1c-53d6a5fa211c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1258 microversion: 2.1 time: 0.651709 Aug 28 10:26:55.964254 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 532/1084] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:55 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1258 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:56.985974 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ee5e99f7-47cd-472e-b0b7-611feb80a012 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:56.987008 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ee5e99f7-47cd-472e-b0b7-611feb80a012 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:56.994512 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee5e99f7-47cd-472e-b0b7-611feb80a012 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:56.995341 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee5e99f7-47cd-472e-b0b7-611feb80a012 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:56.995989 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee5e99f7-47cd-472e-b0b7-611feb80a012 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:56.997632 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee5e99f7-47cd-472e-b0b7-611feb80a012 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:56.998343 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee5e99f7-47cd-472e-b0b7-611feb80a012 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:56.999295 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee5e99f7-47cd-472e-b0b7-611feb80a012 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:57.211379 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-481f4e6a-9ec6-49ad-bbd2-c5b5ad5d264d tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Action: 'create', calling method: .version_select at 0x7f7a1c264c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1740327184"}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:26:57.238777 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ee5e99f7-47cd-472e-b0b7-611feb80a012 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:57.252365 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ee5e99f7-47cd-472e-b0b7-611feb80a012 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1258 microversion: 2.1 time: 0.268047 Aug 28 10:26:57.253508 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 553/1085] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:56 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1258 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:57.393631 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-191c3e05-63c6-4d97-916d-02e9aaf13340 req-1237b11e-0c6e-4062-a91f-1d47bb071c9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae", "name": "network-vif-plugged", "status": "completed", "tag": "39f1800c-cf09-45ec-af04-2a341650fe20"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:26:57.408285 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-191c3e05-63c6-4d97-916d-02e9aaf13340 req-1237b11e-0c6e-4062-a91f-1d47bb071c9a service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:57.408788 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-191c3e05-63c6-4d97-916d-02e9aaf13340 req-1237b11e-0c6e-4062-a91f-1d47bb071c9a service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:57.409209 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-191c3e05-63c6-4d97-916d-02e9aaf13340 req-1237b11e-0c6e-4062-a91f-1d47bb071c9a service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:57.431959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-191c3e05-63c6-4d97-916d-02e9aaf13340 req-1237b11e-0c6e-4062-a91f-1d47bb071c9a service nova] Creating event network-vif-plugged:39f1800c-cf09-45ec-af04-2a341650fe20 for instance 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae on hv-cinder-85200 Aug 28 10:26:57.441961 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-191c3e05-63c6-4d97-916d-02e9aaf13340 req-1237b11e-0c6e-4062-a91f-1d47bb071c9a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052072 Aug 28 10:26:57.443073 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 554/1086] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:26:57.683753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-481f4e6a-9ec6-49ad-bbd2-c5b5ad5d264d tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.611598 Aug 28 10:26:57.684388 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 533/1087] 10.222.0.40 () {60 vars in 1155 bytes} [Sun Aug 28 10:26:57 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 614 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 28 10:26:57.700649 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-310d3f58-4ff5-42b4-b174-8b7b5ab02d30 tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Calling method '.version_select at 0x7f7a1c0cbca0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:57.789066 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-310d3f58-4ff5-42b4-b174-8b7b5ab02d30 tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/34c4a6a8-dcfe-4052-918b-cb62f78df2e3" status: 200 len: 345 microversion: 2.1 time: 0.095867 Aug 28 10:26:57.789708 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 555/1088] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Aug 28 10:26:57 2022] GET /compute/v2.1/os-volumes/34c4a6a8-dcfe-4052-918b-cb62f78df2e3 => generated 345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:26:58.275631 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-ced5650d-96fc-4514-affa-cbcdbb573e52 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:58.278289 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-ced5650d-96fc-4514-affa-cbcdbb573e52 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:58.294526 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ced5650d-96fc-4514-affa-cbcdbb573e52 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:58.295536 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ced5650d-96fc-4514-affa-cbcdbb573e52 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:58.300851 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ced5650d-96fc-4514-affa-cbcdbb573e52 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:58.302119 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ced5650d-96fc-4514-affa-cbcdbb573e52 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:58.302803 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ced5650d-96fc-4514-affa-cbcdbb573e52 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:58.304045 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ced5650d-96fc-4514-affa-cbcdbb573e52 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:58.468990 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-ced5650d-96fc-4514-affa-cbcdbb573e52 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:58.478465 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-ced5650d-96fc-4514-affa-cbcdbb573e52 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1258 microversion: 2.1 time: 0.208451 Aug 28 10:26:58.479401 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 534/1089] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:58 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1258 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:58.806227 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b55bf275-54fc-44f7-b622-18491eed7627 tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Calling method '.version_select at 0x7f7a1c189c10>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:58.903092 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b55bf275-54fc-44f7-b622-18491eed7627 tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/34c4a6a8-dcfe-4052-918b-cb62f78df2e3" status: 200 len: 346 microversion: 2.1 time: 0.101468 Aug 28 10:26:58.903851 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 556/1090] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Aug 28 10:26:58 2022] GET /compute/v2.1/os-volumes/34c4a6a8-dcfe-4052-918b-cb62f78df2e3 => generated 346 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:26:58.916898 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-7c6c9649-ab14-4a6b-bae8-820f7ee6515a tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Action: 'create', calling method: .version_select at 0x7f7a1c264f70>, body: {"snapshot": {"volume_id": "34c4a6a8-dcfe-4052-918b-cb62f78df2e3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-311294121"}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:26:59.106357 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-7c6c9649-ab14-4a6b-bae8-820f7ee6515a tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.194133 Aug 28 10:26:59.107438 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 535/1091] 10.222.0.40 () {60 vars in 1162 bytes} [Sun Aug 28 10:26:58 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:26:59.119191 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b3370e5b-4de8-43c0-baf8-8877c084715b tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Calling method '.version_select at 0x7f7a1c29d160>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:59.154022 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b3370e5b-4de8-43c0-baf8-8877c084715b tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/926ed054-d1fe-40e7-94b3-b721c8804f26" status: 200 len: 286 microversion: 2.1 time: 0.039680 Aug 28 10:26:59.154911 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 557/1092] 10.222.0.40 () {58 vars in 1251 bytes} [Sun Aug 28 10:26:59 2022] GET /compute/v2.1/os-snapshots/926ed054-d1fe-40e7-94b3-b721c8804f26 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:26:59.166310 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-728494cb-09b4-49c5-85d0-73daaed0911c tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Calling method '.version_select at 0x7f7a1c1080d0>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:59.200714 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-728494cb-09b4-49c5-85d0-73daaed0911c tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.038222 Aug 28 10:26:59.201872 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 536/1093] 10.222.0.40 () {58 vars in 1140 bytes} [Sun Aug 28 10:26:59 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:26:59.214206 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-11a9d1e0-a592-452d-9d7a-ef07681da281 tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Calling method '.version_select at 0x7f7a1c189700>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:59.253900 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-11a9d1e0-a592-452d-9d7a-ef07681da281 tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/926ed054-d1fe-40e7-94b3-b721c8804f26" status: 200 len: 286 microversion: 2.1 time: 0.045043 Aug 28 10:26:59.254977 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 558/1094] 10.222.0.40 () {58 vars in 1251 bytes} [Sun Aug 28 10:26:59 2022] GET /compute/v2.1/os-snapshots/926ed054-d1fe-40e7-94b3-b721c8804f26 => generated 286 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:26:59.499617 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-5bb02e76-0697-4220-857f-65b9e505dec2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:59.500304 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-5bb02e76-0697-4220-857f-65b9e505dec2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:59.511513 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5bb02e76-0697-4220-857f-65b9e505dec2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:59.511988 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5bb02e76-0697-4220-857f-65b9e505dec2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:59.512424 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5bb02e76-0697-4220-857f-65b9e505dec2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:59.513155 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5bb02e76-0697-4220-857f-65b9e505dec2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:59.513607 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5bb02e76-0697-4220-857f-65b9e505dec2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:59.514029 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5bb02e76-0697-4220-857f-65b9e505dec2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:59.730994 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-5bb02e76-0697-4220-857f-65b9e505dec2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:59.739312 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-5bb02e76-0697-4220-857f-65b9e505dec2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1441 microversion: 2.1 time: 0.243886 Aug 28 10:26:59.739890 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 537/1095] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:59 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1441 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:26:59.764126 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-91eddc21-2d69-4a36-a250-2d7ad232e686 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:26:59.766760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-91eddc21-2d69-4a36-a250-2d7ad232e686 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:26:59.775820 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91eddc21-2d69-4a36-a250-2d7ad232e686 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:59.776850 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91eddc21-2d69-4a36-a250-2d7ad232e686 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:59.777770 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91eddc21-2d69-4a36-a250-2d7ad232e686 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:59.778752 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91eddc21-2d69-4a36-a250-2d7ad232e686 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:26:59.779398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91eddc21-2d69-4a36-a250-2d7ad232e686 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:26:59.780014 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91eddc21-2d69-4a36-a250-2d7ad232e686 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:26:59.939647 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-91eddc21-2d69-4a36-a250-2d7ad232e686 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:26:59.942089 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:59.948918 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-91eddc21-2d69-4a36-a250-2d7ad232e686 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1441 microversion: 2.1 time: 0.190734 Aug 28 10:26:59.949487 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 559/1096] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:26:59 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1441 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:27:00.270336 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-875cf9e2-746c-450c-972b-dda0428678f2 tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Calling method '.version_select at 0x7f7a1c230040>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:27:00.306716 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-875cf9e2-746c-450c-972b-dda0428678f2 tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/926ed054-d1fe-40e7-94b3-b721c8804f26" status: 200 len: 286 microversion: 2.1 time: 0.040300 Aug 28 10:27:00.312176 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 538/1097] 10.222.0.40 () {58 vars in 1251 bytes} [Sun Aug 28 10:27:00 2022] GET /compute/v2.1/os-snapshots/926ed054-d1fe-40e7-94b3-b721c8804f26 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:27:01.319631 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-58881479-6830-4dc6-b364-ce17308ad788 tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Calling method '.version_select at 0x7f7a1c29df70>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:27:01.350910 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-58881479-6830-4dc6-b364-ce17308ad788 tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/926ed054-d1fe-40e7-94b3-b721c8804f26" status: 200 len: 286 microversion: 2.1 time: 0.035469 Aug 28 10:27:01.356302 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 560/1098] 10.222.0.40 () {58 vars in 1251 bytes} [Sun Aug 28 10:27:01 2022] GET /compute/v2.1/os-snapshots/926ed054-d1fe-40e7-94b3-b721c8804f26 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:27:01.791187 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-0ffcc0bb-d8c0-40bf-b691-3c4f129799b2 req-c7ee40ef-2db8-4475-80b0-8fadcb380287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae", "tag": "39f1800c-cf09-45ec-af04-2a341650fe20"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:27:01.801946 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-0ffcc0bb-d8c0-40bf-b691-3c4f129799b2 req-c7ee40ef-2db8-4475-80b0-8fadcb380287 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:27:01.802423 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-0ffcc0bb-d8c0-40bf-b691-3c4f129799b2 req-c7ee40ef-2db8-4475-80b0-8fadcb380287 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:27:01.802848 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-0ffcc0bb-d8c0-40bf-b691-3c4f129799b2 req-c7ee40ef-2db8-4475-80b0-8fadcb380287 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:27:01.813331 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-0ffcc0bb-d8c0-40bf-b691-3c4f129799b2 req-c7ee40ef-2db8-4475-80b0-8fadcb380287 service nova] Creating event network-changed:39f1800c-cf09-45ec-af04-2a341650fe20 for instance 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae on hv-cinder-85200 Aug 28 10:27:01.818467 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-0ffcc0bb-d8c0-40bf-b691-3c4f129799b2 req-c7ee40ef-2db8-4475-80b0-8fadcb380287 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031737 Aug 28 10:27:01.819056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 539/1099] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:27:02.364188 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1ae78ef8-77ee-4407-8a1d-c3e78ea5ad96 tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Calling method '.version_select at 0x7f7a1c155280>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:27:02.397629 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1ae78ef8-77ee-4407-8a1d-c3e78ea5ad96 tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/926ed054-d1fe-40e7-94b3-b721c8804f26" status: 200 len: 286 microversion: 2.1 time: 0.037965 Aug 28 10:27:02.398194 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 561/1100] 10.222.0.40 () {58 vars in 1251 bytes} [Sun Aug 28 10:27:02 2022] GET /compute/v2.1/os-snapshots/926ed054-d1fe-40e7-94b3-b721c8804f26 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:27:03.411722 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-6d60f281-6a61-4703-b76e-9d022246fd75 tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Calling method '.version_select at 0x7f7a1c3068b0>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:27:03.448677 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-6d60f281-6a61-4703-b76e-9d022246fd75 tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/926ed054-d1fe-40e7-94b3-b721c8804f26" status: 200 len: 287 microversion: 2.1 time: 0.041694 Aug 28 10:27:03.450423 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 540/1101] 10.222.0.40 () {58 vars in 1251 bytes} [Sun Aug 28 10:27:03 2022] GET /compute/v2.1/os-snapshots/926ed054-d1fe-40e7-94b3-b721c8804f26 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:27:03.463689 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f3b94500-b22c-4ddb-a58d-50cfed8ed103 tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Calling method '.version_select at 0x7f7a1c222ee0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:27:03.539456 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f3b94500-b22c-4ddb-a58d-50cfed8ed103 tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/926ed054-d1fe-40e7-94b3-b721c8804f26" status: 202 len: 0 microversion: 2.1 time: 0.080949 Aug 28 10:27:03.540081 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 562/1102] 10.222.0.40 () {58 vars in 1254 bytes} [Sun Aug 28 10:27:03 2022] DELETE /compute/v2.1/os-snapshots/926ed054-d1fe-40e7-94b3-b721c8804f26 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:27:03.548954 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-26ba9ac6-bd63-424b-a23d-7a3722f91dff tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Calling method '.version_select at 0x7f7a1c2641f0>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:27:03.601320 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-26ba9ac6-bd63-424b-a23d-7a3722f91dff tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/926ed054-d1fe-40e7-94b3-b721c8804f26" status: 200 len: 286 microversion: 2.1 time: 0.056687 Aug 28 10:27:03.601934 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 541/1103] 10.222.0.40 () {58 vars in 1251 bytes} [Sun Aug 28 10:27:03 2022] GET /compute/v2.1/os-snapshots/926ed054-d1fe-40e7-94b3-b721c8804f26 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:27:04.615490 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fbbc1f4b-bd74-42ab-8625-bce73b00164e tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Calling method '.version_select at 0x7f7a1c26e310>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:27:04.640841 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-fbbc1f4b-bd74-42ab-8625-bce73b00164e tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] HTTP exception thrown: Snapshot 926ed054-d1fe-40e7-94b3-b721c8804f26 could not be found. Aug 28 10:27:04.643164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fbbc1f4b-bd74-42ab-8625-bce73b00164e tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Request method failure captured: Aug 28 10:27:04.643164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/os-snapshots/926ed054-d1fe-40e7-94b3-b721c8804f26 HTTP/1.1 Aug 28 10:27:04.643164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:27:04.643164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:27:04.643164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:27:04.643164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:27:04.643164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:27:04.643164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:27:04.643164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:27:04.643164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:27:04.643164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0Lwwx7iVfwxBBNND_f5T05x53dPa4VTC-OxjH_ihK6y2fkllEw1EEEEF8WxWWP5msy--oOrZDjVyup0JUfjm6s_CxzykxM0eI5q1ENHjjXMeBmy7hFM57GJWA5gClT_NI4l6VXdoN_-aX3WsgE0Ysg7I3SiLnlcmYkn17MUZ_vCAYU Aug 28 10:27:04.643164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:27:04.643164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:27:04.643164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:27:04.643164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:27:04.643164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:27:04.643164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:27:04.643164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: c23917efa14f437fa209cf1542930786 Aug 28 10:27:04.643164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-253067162 Aug 28 10:27:04.643164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:27:04.643164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:27:04.644610 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c23917efa14f437fa209cf1542930786", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c23917efa14f437fa209cf1542930786"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c23917efa14f437fa209cf1542930786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c23917efa14f437fa209cf1542930786"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:27:04.644610 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesSnapshotsTestJSON-253067162 Aug 28 10:27:04.644610 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: c23917efa14f437fa209cf1542930786 Aug 28 10:27:04.644610 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-253067162 Aug 28 10:27:04.644610 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesSnapshotsTestJSON-253067162-project Aug 28 10:27:04.644610 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:27:04.644610 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:27:04.644610 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: 71761b6bb94d40468244449ec2e06a1e Aug 28 10:27:04.644610 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesSnapshotsTestJSON-253067162-project Aug 28 10:27:04.644610 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: Aug 28 10:27:04.644610 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Snapshot 926ed054-d1fe-40e7-94b3-b721c8804f26 could not be found. Aug 28 10:27:04.644610 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '926ed054-d1fe-40e7-94b3-b721c8804f26'} Aug 28 10:27:04.644610 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:27:04.645453 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:27:04.645453 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 28 10:27:04.645453 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 28 10:27:04.645453 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 28 10:27:04.645453 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 28 10:27:04.645453 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 28 10:27:04.645453 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 28 10:27:04.645453 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 28 10:27:04.645453 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 28 10:27:04.645453 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 28 10:27:04.645453 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 28 10:27:04.645453 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 28 10:27:04.645453 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 28 10:27:04.645453 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 28 10:27:04.645453 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 28 10:27:04.645453 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 926ed054-d1fe-40e7-94b3-b721c8804f26 could not be found. (HTTP 404) (Request-ID: req-923c3165-f5e4-4d70-8479-5fca203f525d) Aug 28 10:27:04.645453 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:27:04.645453 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:27:04.646607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:27:04.646607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:27:04.646607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 28 10:27:04.646607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 28 10:27:04.646607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 28 10:27:04.646607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 28 10:27:04.646607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 28 10:27:04.646607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 28 10:27:04.646607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 28 10:27:04.646607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 28 10:27:04.646607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 28 10:27:04.646607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 28 10:27:04.646607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 28 10:27:04.646607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 28 10:27:04.646607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 28 10:27:04.646607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 28 10:27:04.646607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 28 10:27:04.646607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 28 10:27:04.646607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 28 10:27:04.647802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 28 10:27:04.647802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 28 10:27:04.647802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 28 10:27:04.647802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 28 10:27:04.647802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 28 10:27:04.647802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 926ed054-d1fe-40e7-94b3-b721c8804f26 could not be found. Aug 28 10:27:04.647802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:27:04.647802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:27:04.647802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:27:04.647802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:27:04.647802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:27:04.647802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:27:04.647802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:27:04.647802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:27:04.647802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 28 10:27:04.647802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 28 10:27:04.647802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:27:04.647802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:27:04.647802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 28 10:27:04.647802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:27:04.649981 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 926ed054-d1fe-40e7-94b3-b721c8804f26 could not be found. Aug 28 10:27:04.649981 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:27:04.649981 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:27:04.649981 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:27:04.649981 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:27:04.649981 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:27:04.649981 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:27:04.649981 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:27:04.649981 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:27:04.649981 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 926ed054-d1fe-40e7-94b3-b721c8804f26 could not be found. Aug 28 10:27:04.649981 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:27:04.649981 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fbbc1f4b-bd74-42ab-8625-bce73b00164e tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Returning 404 to user: Snapshot 926ed054-d1fe-40e7-94b3-b721c8804f26 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:27:04.649981 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fbbc1f4b-bd74-42ab-8625-bce73b00164e tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/926ed054-d1fe-40e7-94b3-b721c8804f26" status: 404 len: 111 microversion: 2.1 time: 0.034199 Aug 28 10:27:04.651085 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 563/1104] 10.222.0.40 () {58 vars in 1251 bytes} [Sun Aug 28 10:27:04 2022] GET /compute/v2.1/os-snapshots/926ed054-d1fe-40e7-94b3-b721c8804f26 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:27:04.653759 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-097e1498-282b-461d-8e03-a23e85c1fc0b tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Calling method '.version_select at 0x7f7a1c230280>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:27:04.722947 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-097e1498-282b-461d-8e03-a23e85c1fc0b tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/34c4a6a8-dcfe-4052-918b-cb62f78df2e3" status: 202 len: 0 microversion: 2.1 time: 0.073370 Aug 28 10:27:04.723520 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 542/1105] 10.222.0.40 () {58 vars in 1248 bytes} [Sun Aug 28 10:27:04 2022] DELETE /compute/v2.1/os-volumes/34c4a6a8-dcfe-4052-918b-cb62f78df2e3 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:27:04.731919 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4b5600e9-55aa-4a8b-a007-17fd2b30b577 tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Calling method '.version_select at 0x7f7a1c29dc10>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:27:04.784954 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4b5600e9-55aa-4a8b-a007-17fd2b30b577 tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/34c4a6a8-dcfe-4052-918b-cb62f78df2e3" status: 200 len: 345 microversion: 2.1 time: 0.056993 Aug 28 10:27:04.785521 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 564/1106] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Aug 28 10:27:04 2022] GET /compute/v2.1/os-volumes/34c4a6a8-dcfe-4052-918b-cb62f78df2e3 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:27:05.799951 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-ddeb6932-5d61-4bfc-8984-4b361561967d tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Calling method '.version_select at 0x7f7a1c3065e0>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:27:05.831781 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-ddeb6932-5d61-4bfc-8984-4b361561967d tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] HTTP exception thrown: Volume 34c4a6a8-dcfe-4052-918b-cb62f78df2e3 could not be found. Aug 28 10:27:05.833915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-ddeb6932-5d61-4bfc-8984-4b361561967d tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Request method failure captured: Aug 28 10:27:05.833915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: GET /compute/v2.1/os-volumes/34c4a6a8-dcfe-4052-918b-cb62f78df2e3 HTTP/1.1 Aug 28 10:27:05.833915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:27:05.833915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:27:05.833915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:27:05.833915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:27:05.833915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:27:05.833915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:27:05.833915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:27:05.833915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:27:05.833915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0Lwwx7iVfwxBBNND_f5T05x53dPa4VTC-OxjH_ihK6y2fkllEw1EEEEF8WxWWP5msy--oOrZDjVyup0JUfjm6s_CxzykxM0eI5q1ENHjjXMeBmy7hFM57GJWA5gClT_NI4l6VXdoN_-aX3WsgE0Ysg7I3SiLnlcmYkn17MUZ_vCAYU Aug 28 10:27:05.833915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:27:05.833915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:27:05.833915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:27:05.833915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:27:05.833915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:27:05.833915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:27:05.833915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: c23917efa14f437fa209cf1542930786 Aug 28 10:27:05.833915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-253067162 Aug 28 10:27:05.833915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:27:05.833915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:27:05.835567 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c23917efa14f437fa209cf1542930786", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c23917efa14f437fa209cf1542930786"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c23917efa14f437fa209cf1542930786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c23917efa14f437fa209cf1542930786"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:27:05.835567 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-VolumesSnapshotsTestJSON-253067162 Aug 28 10:27:05.835567 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: c23917efa14f437fa209cf1542930786 Aug 28 10:27:05.835567 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-253067162 Aug 28 10:27:05.835567 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-VolumesSnapshotsTestJSON-253067162-project Aug 28 10:27:05.835567 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:27:05.835567 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:27:05.835567 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: 71761b6bb94d40468244449ec2e06a1e Aug 28 10:27:05.835567 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-VolumesSnapshotsTestJSON-253067162-project Aug 28 10:27:05.835567 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: Aug 28 10:27:05.835567 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Volume 34c4a6a8-dcfe-4052-918b-cb62f78df2e3 could not be found. Aug 28 10:27:05.835567 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': '34c4a6a8-dcfe-4052-918b-cb62f78df2e3'} Aug 28 10:27:05.835567 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:27:05.836396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:27:05.836396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 28 10:27:05.836396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 28 10:27:05.836396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 28 10:27:05.836396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 28 10:27:05.836396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 28 10:27:05.836396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 28 10:27:05.836396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 28 10:27:05.836396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 28 10:27:05.836396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 28 10:27:05.836396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 28 10:27:05.836396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 28 10:27:05.836396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 28 10:27:05.836396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 28 10:27:05.836396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 28 10:27:05.836396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 34c4a6a8-dcfe-4052-918b-cb62f78df2e3 could not be found. (HTTP 404) (Request-ID: req-547c9ac4-edc8-435c-8459-e88975435a58) Aug 28 10:27:05.836396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:27:05.836396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:27:05.836396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:27:05.837757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:27:05.837757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 28 10:27:05.837757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 28 10:27:05.837757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 28 10:27:05.837757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 28 10:27:05.837757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 28 10:27:05.837757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 28 10:27:05.837757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 28 10:27:05.837757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 28 10:27:05.837757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 28 10:27:05.837757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 28 10:27:05.837757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 28 10:27:05.837757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 28 10:27:05.837757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 28 10:27:05.837757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 28 10:27:05.837757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 28 10:27:05.837757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 28 10:27:05.837757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 28 10:27:05.837757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 28 10:27:05.839047 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 28 10:27:05.839047 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 28 10:27:05.839047 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 28 10:27:05.839047 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 28 10:27:05.839047 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 34c4a6a8-dcfe-4052-918b-cb62f78df2e3 could not be found. Aug 28 10:27:05.839047 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:27:05.839047 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:27:05.839047 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:27:05.839047 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:27:05.839047 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:27:05.839047 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:27:05.839047 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:27:05.839047 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:27:05.839047 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 28 10:27:05.839047 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 28 10:27:05.839047 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:27:05.839047 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:27:05.839047 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 28 10:27:05.839047 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:27:05.841064 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 34c4a6a8-dcfe-4052-918b-cb62f78df2e3 could not be found. Aug 28 10:27:05.841064 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:27:05.841064 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:27:05.841064 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:27:05.841064 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:27:05.841064 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:27:05.841064 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:27:05.841064 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:27:05.841064 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:27:05.841064 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 34c4a6a8-dcfe-4052-918b-cb62f78df2e3 could not be found. Aug 28 10:27:05.841064 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:27:05.841064 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-ddeb6932-5d61-4bfc-8984-4b361561967d tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Returning 404 to user: Volume 34c4a6a8-dcfe-4052-918b-cb62f78df2e3 could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:27:05.841064 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-ddeb6932-5d61-4bfc-8984-4b361561967d tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/34c4a6a8-dcfe-4052-918b-cb62f78df2e3" status: 404 len: 109 microversion: 2.1 time: 0.040629 Aug 28 10:27:05.845870 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 543/1107] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Aug 28 10:27:05 2022] GET /compute/v2.1/os-volumes/34c4a6a8-dcfe-4052-918b-cb62f78df2e3 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:27:05.851977 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fc95cdbd-811b-4cb0-babc-3d1d64ecdf57 tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Calling method '.version_select at 0x7f7a1c26e3a0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:27:05.882712 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-fc95cdbd-811b-4cb0-babc-3d1d64ecdf57 tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] HTTP exception thrown: Volume 34c4a6a8-dcfe-4052-918b-cb62f78df2e3 could not be found. Aug 28 10:27:05.884760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fc95cdbd-811b-4cb0-babc-3d1d64ecdf57 tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Request method failure captured: Aug 28 10:27:05.884760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: DELETE /compute/v2.1/os-volumes/34c4a6a8-dcfe-4052-918b-cb62f78df2e3 HTTP/1.1 Aug 28 10:27:05.884760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:27:05.884760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:27:05.884760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:27:05.884760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:27:05.884760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:27:05.884760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:27:05.884760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:27:05.884760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:27:05.884760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0Lwwx7iVfwxBBNND_f5T05x53dPa4VTC-OxjH_ihK6y2fkllEw1EEEEF8WxWWP5msy--oOrZDjVyup0JUfjm6s_CxzykxM0eI5q1ENHjjXMeBmy7hFM57GJWA5gClT_NI4l6VXdoN_-aX3WsgE0Ysg7I3SiLnlcmYkn17MUZ_vCAYU Aug 28 10:27:05.884760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:27:05.884760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:27:05.884760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:27:05.884760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:27:05.884760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:27:05.884760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:27:05.884760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: c23917efa14f437fa209cf1542930786 Aug 28 10:27:05.884760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-253067162 Aug 28 10:27:05.884760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:27:05.884760 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:27:05.886161 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c23917efa14f437fa209cf1542930786", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c23917efa14f437fa209cf1542930786"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c23917efa14f437fa209cf1542930786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c23917efa14f437fa209cf1542930786"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:27:05.886161 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesSnapshotsTestJSON-253067162 Aug 28 10:27:05.886161 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: c23917efa14f437fa209cf1542930786 Aug 28 10:27:05.886161 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-253067162 Aug 28 10:27:05.886161 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesSnapshotsTestJSON-253067162-project Aug 28 10:27:05.886161 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:27:05.886161 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:27:05.886161 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: 71761b6bb94d40468244449ec2e06a1e Aug 28 10:27:05.886161 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesSnapshotsTestJSON-253067162-project Aug 28 10:27:05.886161 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: Aug 28 10:27:05.886161 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Volume 34c4a6a8-dcfe-4052-918b-cb62f78df2e3 could not be found. Aug 28 10:27:05.886161 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '34c4a6a8-dcfe-4052-918b-cb62f78df2e3'} Aug 28 10:27:05.886161 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:27:05.890296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:27:05.890296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 28 10:27:05.890296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 28 10:27:05.890296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 28 10:27:05.890296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 28 10:27:05.890296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 28 10:27:05.890296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 28 10:27:05.890296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 28 10:27:05.890296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 28 10:27:05.890296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 28 10:27:05.890296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 28 10:27:05.890296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 28 10:27:05.890296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 28 10:27:05.890296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 28 10:27:05.890296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 28 10:27:05.890296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 34c4a6a8-dcfe-4052-918b-cb62f78df2e3 could not be found. (HTTP 404) (Request-ID: req-3faf5e23-eaec-4b7c-ad2f-4e6c579a9e8c) Aug 28 10:27:05.890296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:27:05.890296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:27:05.890296 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:27:05.891492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:27:05.891492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 28 10:27:05.891492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 28 10:27:05.891492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 28 10:27:05.891492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 28 10:27:05.891492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 28 10:27:05.891492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 28 10:27:05.891492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 28 10:27:05.891492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 28 10:27:05.891492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 28 10:27:05.891492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 28 10:27:05.891492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 28 10:27:05.891492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 28 10:27:05.891492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 28 10:27:05.891492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 28 10:27:05.891492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 28 10:27:05.891492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 28 10:27:05.891492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 28 10:27:05.891492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 28 10:27:05.894970 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 28 10:27:05.894970 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 28 10:27:05.894970 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 28 10:27:05.894970 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 28 10:27:05.894970 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 34c4a6a8-dcfe-4052-918b-cb62f78df2e3 could not be found. Aug 28 10:27:05.894970 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:27:05.894970 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:27:05.894970 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:27:05.894970 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:27:05.894970 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:27:05.894970 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:27:05.894970 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:27:05.894970 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:27:05.894970 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 28 10:27:05.894970 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 28 10:27:05.894970 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:27:05.894970 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:27:05.894970 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 28 10:27:05.894970 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:27:05.896624 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 34c4a6a8-dcfe-4052-918b-cb62f78df2e3 could not be found. Aug 28 10:27:05.896624 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:27:05.896624 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:27:05.896624 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:27:05.896624 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:27:05.896624 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:27:05.896624 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:27:05.896624 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:27:05.896624 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:27:05.896624 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 34c4a6a8-dcfe-4052-918b-cb62f78df2e3 could not be found. Aug 28 10:27:05.896624 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:27:05.896624 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fc95cdbd-811b-4cb0-babc-3d1d64ecdf57 tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Returning 404 to user: Volume 34c4a6a8-dcfe-4052-918b-cb62f78df2e3 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:27:05.896624 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fc95cdbd-811b-4cb0-babc-3d1d64ecdf57 tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/34c4a6a8-dcfe-4052-918b-cb62f78df2e3" status: 404 len: 109 microversion: 2.1 time: 0.039238 Aug 28 10:27:05.896624 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 565/1108] 10.222.0.40 () {58 vars in 1248 bytes} [Sun Aug 28 10:27:05 2022] DELETE /compute/v2.1/os-volumes/34c4a6a8-dcfe-4052-918b-cb62f78df2e3 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 28 10:27:05.897651 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-bb7a9aeb-6309-464d-bfdd-c840182c688a tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Calling method '.version_select at 0x7f7a1c2c3dc0>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:27:05.926242 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-bb7a9aeb-6309-464d-bfdd-c840182c688a tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] HTTP exception thrown: Volume 34c4a6a8-dcfe-4052-918b-cb62f78df2e3 could not be found. Aug 28 10:27:05.928493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-bb7a9aeb-6309-464d-bfdd-c840182c688a tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Request method failure captured: Aug 28 10:27:05.928493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: GET /compute/v2.1/os-volumes/34c4a6a8-dcfe-4052-918b-cb62f78df2e3 HTTP/1.1 Aug 28 10:27:05.928493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:27:05.928493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:27:05.928493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:27:05.928493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:27:05.928493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:27:05.928493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:27:05.928493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:27:05.928493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:27:05.928493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0Lwwx7iVfwxBBNND_f5T05x53dPa4VTC-OxjH_ihK6y2fkllEw1EEEEF8WxWWP5msy--oOrZDjVyup0JUfjm6s_CxzykxM0eI5q1ENHjjXMeBmy7hFM57GJWA5gClT_NI4l6VXdoN_-aX3WsgE0Ysg7I3SiLnlcmYkn17MUZ_vCAYU Aug 28 10:27:05.928493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:27:05.928493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:27:05.928493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:27:05.928493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:27:05.928493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:27:05.928493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:27:05.928493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: c23917efa14f437fa209cf1542930786 Aug 28 10:27:05.928493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-253067162 Aug 28 10:27:05.928493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:27:05.928493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:27:05.930275 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c23917efa14f437fa209cf1542930786", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c23917efa14f437fa209cf1542930786"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c23917efa14f437fa209cf1542930786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c23917efa14f437fa209cf1542930786"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:27:05.930275 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-VolumesSnapshotsTestJSON-253067162 Aug 28 10:27:05.930275 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: c23917efa14f437fa209cf1542930786 Aug 28 10:27:05.930275 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-253067162 Aug 28 10:27:05.930275 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-VolumesSnapshotsTestJSON-253067162-project Aug 28 10:27:05.930275 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:27:05.930275 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:27:05.930275 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: 71761b6bb94d40468244449ec2e06a1e Aug 28 10:27:05.930275 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-VolumesSnapshotsTestJSON-253067162-project Aug 28 10:27:05.930275 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: Aug 28 10:27:05.930275 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Volume 34c4a6a8-dcfe-4052-918b-cb62f78df2e3 could not be found. Aug 28 10:27:05.930275 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': '34c4a6a8-dcfe-4052-918b-cb62f78df2e3'} Aug 28 10:27:05.930275 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:27:05.931360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:27:05.931360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 28 10:27:05.931360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 28 10:27:05.931360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 28 10:27:05.931360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 28 10:27:05.931360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 28 10:27:05.931360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 28 10:27:05.931360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 28 10:27:05.931360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 28 10:27:05.931360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 28 10:27:05.931360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 28 10:27:05.931360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 28 10:27:05.931360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 28 10:27:05.931360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 28 10:27:05.931360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 28 10:27:05.931360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 34c4a6a8-dcfe-4052-918b-cb62f78df2e3 could not be found. (HTTP 404) (Request-ID: req-83f94f81-61ac-460d-b4fc-2c6ca9cc3842) Aug 28 10:27:05.931360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:27:05.931360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:27:05.931360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:27:05.932859 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:27:05.932859 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 28 10:27:05.932859 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 28 10:27:05.932859 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 28 10:27:05.932859 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 28 10:27:05.932859 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 28 10:27:05.932859 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 28 10:27:05.932859 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 28 10:27:05.932859 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 28 10:27:05.932859 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 28 10:27:05.932859 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 28 10:27:05.932859 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 28 10:27:05.932859 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 28 10:27:05.932859 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 28 10:27:05.932859 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 28 10:27:05.932859 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 28 10:27:05.932859 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 28 10:27:05.932859 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 28 10:27:05.932859 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 28 10:27:05.934206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 28 10:27:05.934206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 28 10:27:05.934206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 28 10:27:05.934206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 28 10:27:05.934206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 34c4a6a8-dcfe-4052-918b-cb62f78df2e3 could not be found. Aug 28 10:27:05.934206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:27:05.934206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:27:05.934206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:27:05.934206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:27:05.934206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:27:05.934206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:27:05.934206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:27:05.934206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:27:05.934206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 28 10:27:05.934206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 28 10:27:05.934206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:27:05.934206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:27:05.934206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 28 10:27:05.934206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:27:05.936012 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 34c4a6a8-dcfe-4052-918b-cb62f78df2e3 could not be found. Aug 28 10:27:05.936012 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:27:05.936012 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:27:05.936012 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:27:05.936012 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:27:05.936012 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:27:05.936012 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:27:05.936012 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:27:05.936012 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:27:05.936012 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 34c4a6a8-dcfe-4052-918b-cb62f78df2e3 could not be found. Aug 28 10:27:05.936012 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:27:05.936012 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-bb7a9aeb-6309-464d-bfdd-c840182c688a tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] Returning 404 to user: Volume 34c4a6a8-dcfe-4052-918b-cb62f78df2e3 could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:27:05.936012 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-bb7a9aeb-6309-464d-bfdd-c840182c688a tempest-VolumesSnapshotsTestJSON-253067162 tempest-VolumesSnapshotsTestJSON-253067162-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/34c4a6a8-dcfe-4052-918b-cb62f78df2e3" status: 404 len: 109 microversion: 2.1 time: 0.042301 Aug 28 10:27:05.936012 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 544/1109] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Aug 28 10:27:05 2022] GET /compute/v2.1/os-volumes/34c4a6a8-dcfe-4052-918b-cb62f78df2e3 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:27:50.686671 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:50.687412 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:50.692304 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-575334eb-eb41-49b6-85e4-4985c6a38e1d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Action: 'create', calling method: .version_select at 0x7f7a1c4f0b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1204136317", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJy3BxXS3htFG0kJ835nUFXKvrQY9OExzIz34QXedYqiYEdVRyG8I6+cU7qiYjJLRTM6dPEIJ2ylXAdIO3NY0Nqw5q5EngrC1b2wtDVe42TUqUwtV8AtfY7ePgfw1UFt7g=="}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:27:50.716398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-575334eb-eb41-49b6-85e4-4985c6a38e1d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Getting quotas for project d82620aefc2f4df9a5aa6492c2786385. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:27:50.717776 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-575334eb-eb41-49b6-85e4-4985c6a38e1d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Getting quotas for user 8e56cbeb9e4f46ffa262c788a61e4bf4 and project d82620aefc2f4df9a5aa6492c2786385. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:27:50.743509 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-575334eb-eb41-49b6-85e4-4985c6a38e1d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.058275 Aug 28 10:27:50.744109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 566/1110] 10.222.0.40 () {60 vars in 1159 bytes} [Sun Aug 28 10:27:50 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:27:50.794772 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:50.795519 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:50.800542 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-1de5917a-fe8b-4158-90de-2a700df97b43 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-795604861", "imageRef": "a6afef9a-a099-4017-970c-97d7a7e66693", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1204136317", "networks": [{"uuid": "7abb91fb-2b9f-49c5-9ac8-04c5876db2a0"}]}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:27:50.855664 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.network.neutron [None req-1de5917a-fe8b-4158-90de-2a700df97b43 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] validate_networks() for [('7abb91fb-2b9f-49c5-9ac8-04c5876db2a0', None, None, None, None, None)] {{(pid=120664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 28 10:27:51.335197 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-1de5917a-fe8b-4158-90de-2a700df97b43 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Flavor limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 28 10:27:51.335778 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-1de5917a-fe8b-4158-90de-2a700df97b43 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Image limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 28 10:27:51.336452 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-1de5917a-fe8b-4158-90de-2a700df97b43 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Flavor pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 28 10:27:51.337094 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-1de5917a-fe8b-4158-90de-2a700df97b43 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Image pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 28 10:27:51.337663 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-1de5917a-fe8b-4158-90de-2a700df97b43 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 28 10:27:51.350788 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1de5917a-fe8b-4158-90de-2a700df97b43 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:27:51.351264 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1de5917a-fe8b-4158-90de-2a700df97b43 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:27:51.351723 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1de5917a-fe8b-4158-90de-2a700df97b43 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:27:51.352459 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1de5917a-fe8b-4158-90de-2a700df97b43 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:27:51.353484 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1de5917a-fe8b-4158-90de-2a700df97b43 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:27:51.353484 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1de5917a-fe8b-4158-90de-2a700df97b43 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:27:51.370562 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-1de5917a-fe8b-4158-90de-2a700df97b43 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Getting quotas for project d82620aefc2f4df9a5aa6492c2786385. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:27:51.374778 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-1de5917a-fe8b-4158-90de-2a700df97b43 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Getting quotas for user 8e56cbeb9e4f46ffa262c788a61e4bf4 and project d82620aefc2f4df9a5aa6492c2786385. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:27:51.386356 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-1de5917a-fe8b-4158-90de-2a700df97b43 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Going to run 1 instances... {{(pid=120664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 28 10:27:51.388689 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-1de5917a-fe8b-4158-90de-2a700df97b43 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6afef9a-a099-4017-970c-97d7a7e66693',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 28 10:27:51.440883 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-1de5917a-fe8b-4158-90de-2a700df97b43 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.647938 Aug 28 10:27:51.441508 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 545/1111] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Aug 28 10:27:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 28 10:27:51.452553 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-12c6dee4-af4b-4f1f-89bf-68736837620e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:27:51.453493 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-12c6dee4-af4b-4f1f-89bf-68736837620e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:27:51.507548 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-12c6dee4-af4b-4f1f-89bf-68736837620e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:27:51.515610 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-12c6dee4-af4b-4f1f-89bf-68736837620e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1258 microversion: 2.1 time: 0.067127 Aug 28 10:27:51.516677 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 567/1112] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:27:51 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:27:52.536159 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f3efb217-019e-4dec-8cb1-5e11d9cd9dc8 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:27:52.536774 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f3efb217-019e-4dec-8cb1-5e11d9cd9dc8 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:27:52.545225 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f3efb217-019e-4dec-8cb1-5e11d9cd9dc8 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:27:52.545703 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f3efb217-019e-4dec-8cb1-5e11d9cd9dc8 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:27:52.546133 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f3efb217-019e-4dec-8cb1-5e11d9cd9dc8 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:27:52.546823 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f3efb217-019e-4dec-8cb1-5e11d9cd9dc8 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:27:52.547304 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f3efb217-019e-4dec-8cb1-5e11d9cd9dc8 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:27:52.547727 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f3efb217-019e-4dec-8cb1-5e11d9cd9dc8 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:27:52.616815 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f3efb217-019e-4dec-8cb1-5e11d9cd9dc8 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:27:52.624803 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f3efb217-019e-4dec-8cb1-5e11d9cd9dc8 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1310 microversion: 2.1 time: 0.092650 Aug 28 10:27:52.625368 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 546/1113] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:27:52 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1310 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:27:53.646207 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2035d512-6f07-4802-bbec-ae5c60d28a32 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:27:53.647523 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2035d512-6f07-4802-bbec-ae5c60d28a32 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:27:53.657160 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2035d512-6f07-4802-bbec-ae5c60d28a32 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:27:53.657920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2035d512-6f07-4802-bbec-ae5c60d28a32 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:27:53.659085 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2035d512-6f07-4802-bbec-ae5c60d28a32 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:27:53.660995 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2035d512-6f07-4802-bbec-ae5c60d28a32 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:27:53.663333 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2035d512-6f07-4802-bbec-ae5c60d28a32 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:27:53.664383 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2035d512-6f07-4802-bbec-ae5c60d28a32 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:27:53.879278 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2035d512-6f07-4802-bbec-ae5c60d28a32 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:27:53.888012 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2035d512-6f07-4802-bbec-ae5c60d28a32 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.246447 Aug 28 10:27:53.888628 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 568/1114] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:27:53 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:27:54.910317 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-81d96001-9282-41d9-b5d9-d65ff2587857 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:27:54.910924 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-81d96001-9282-41d9-b5d9-d65ff2587857 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:27:54.917740 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-81d96001-9282-41d9-b5d9-d65ff2587857 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:27:54.918223 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-81d96001-9282-41d9-b5d9-d65ff2587857 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:27:54.918646 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-81d96001-9282-41d9-b5d9-d65ff2587857 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:27:54.919757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-81d96001-9282-41d9-b5d9-d65ff2587857 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:27:54.920211 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-81d96001-9282-41d9-b5d9-d65ff2587857 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:27:54.920653 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-81d96001-9282-41d9-b5d9-d65ff2587857 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:27:55.077969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-81d96001-9282-41d9-b5d9-d65ff2587857 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:27:55.086171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-81d96001-9282-41d9-b5d9-d65ff2587857 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.179784 Aug 28 10:27:55.087054 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 547/1115] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:27:54 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:27:56.107532 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-82af3140-f780-4137-8247-8eb3a7d650eb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:27:56.108134 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-82af3140-f780-4137-8247-8eb3a7d650eb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:27:56.114791 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82af3140-f780-4137-8247-8eb3a7d650eb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:27:56.115269 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82af3140-f780-4137-8247-8eb3a7d650eb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:27:56.115692 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82af3140-f780-4137-8247-8eb3a7d650eb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:27:56.116378 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82af3140-f780-4137-8247-8eb3a7d650eb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:27:56.116852 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82af3140-f780-4137-8247-8eb3a7d650eb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:27:56.117330 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82af3140-f780-4137-8247-8eb3a7d650eb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:27:56.282980 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-82af3140-f780-4137-8247-8eb3a7d650eb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:27:56.305176 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-82af3140-f780-4137-8247-8eb3a7d650eb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.199739 Aug 28 10:27:56.317122 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 569/1116] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:27:56 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:27:57.342671 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-aff81ba5-c779-4757-a54c-68fd46b7aaf6 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:27:57.342671 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-aff81ba5-c779-4757-a54c-68fd46b7aaf6 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:27:57.349678 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aff81ba5-c779-4757-a54c-68fd46b7aaf6 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:27:57.350218 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aff81ba5-c779-4757-a54c-68fd46b7aaf6 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:27:57.350563 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aff81ba5-c779-4757-a54c-68fd46b7aaf6 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:27:57.351342 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aff81ba5-c779-4757-a54c-68fd46b7aaf6 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:27:57.351753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aff81ba5-c779-4757-a54c-68fd46b7aaf6 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:27:57.352143 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-aff81ba5-c779-4757-a54c-68fd46b7aaf6 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:27:57.494489 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-aff81ba5-c779-4757-a54c-68fd46b7aaf6 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:27:57.502481 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-aff81ba5-c779-4757-a54c-68fd46b7aaf6 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.164721 Aug 28 10:27:57.503057 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 548/1117] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:27:57 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:27:58.523591 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ea8612bf-d6f4-4833-9123-0ec425dbb674 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:27:58.525175 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ea8612bf-d6f4-4833-9123-0ec425dbb674 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:27:58.532963 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ea8612bf-d6f4-4833-9123-0ec425dbb674 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:27:58.533540 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ea8612bf-d6f4-4833-9123-0ec425dbb674 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:27:58.534034 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ea8612bf-d6f4-4833-9123-0ec425dbb674 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:27:58.534799 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ea8612bf-d6f4-4833-9123-0ec425dbb674 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:27:58.535365 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ea8612bf-d6f4-4833-9123-0ec425dbb674 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:27:58.535821 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ea8612bf-d6f4-4833-9123-0ec425dbb674 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:27:58.674665 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ea8612bf-d6f4-4833-9123-0ec425dbb674 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:27:58.682566 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ea8612bf-d6f4-4833-9123-0ec425dbb674 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.163350 Aug 28 10:27:58.695774 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 570/1118] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:27:58 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:27:59.704056 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-b3ffd2b9-f7a1-4b8b-a12c-0f08e300fd69 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:27:59.705812 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-b3ffd2b9-f7a1-4b8b-a12c-0f08e300fd69 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:27:59.712420 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b3ffd2b9-f7a1-4b8b-a12c-0f08e300fd69 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:27:59.712933 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b3ffd2b9-f7a1-4b8b-a12c-0f08e300fd69 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:27:59.713363 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b3ffd2b9-f7a1-4b8b-a12c-0f08e300fd69 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:27:59.714065 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b3ffd2b9-f7a1-4b8b-a12c-0f08e300fd69 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:27:59.714510 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b3ffd2b9-f7a1-4b8b-a12c-0f08e300fd69 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:27:59.714956 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-b3ffd2b9-f7a1-4b8b-a12c-0f08e300fd69 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:27:59.862001 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-b3ffd2b9-f7a1-4b8b-a12c-0f08e300fd69 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:27:59.872020 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-b3ffd2b9-f7a1-4b8b-a12c-0f08e300fd69 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.172181 Aug 28 10:27:59.872730 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 549/1119] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:27:59 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:00.893171 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-09eb0577-d444-4857-9a14-94d88b0b50df tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:00.893884 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-09eb0577-d444-4857-9a14-94d88b0b50df tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:00.900410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-09eb0577-d444-4857-9a14-94d88b0b50df tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:00.900924 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-09eb0577-d444-4857-9a14-94d88b0b50df tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:00.901337 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-09eb0577-d444-4857-9a14-94d88b0b50df tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:00.902081 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-09eb0577-d444-4857-9a14-94d88b0b50df tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:00.902533 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-09eb0577-d444-4857-9a14-94d88b0b50df tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:00.902948 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-09eb0577-d444-4857-9a14-94d88b0b50df tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:01.047108 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-09eb0577-d444-4857-9a14-94d88b0b50df tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:01.055147 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-09eb0577-d444-4857-9a14-94d88b0b50df tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.165925 Aug 28 10:28:01.055725 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 571/1120] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:00 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:02.076258 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8c701173-1914-40c7-aa23-1438673fd2d5 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:02.076961 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-8c701173-1914-40c7-aa23-1438673fd2d5 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:02.080431 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=2 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:28:02.081348 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=6 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:28:02.086499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8c701173-1914-40c7-aa23-1438673fd2d5 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:02.087195 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8c701173-1914-40c7-aa23-1438673fd2d5 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:02.087797 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8c701173-1914-40c7-aa23-1438673fd2d5 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:02.089018 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8c701173-1914-40c7-aa23-1438673fd2d5 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:02.089688 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8c701173-1914-40c7-aa23-1438673fd2d5 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:02.090211 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8c701173-1914-40c7-aa23-1438673fd2d5 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:02.227665 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8c701173-1914-40c7-aa23-1438673fd2d5 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:02.236556 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-8c701173-1914-40c7-aa23-1438673fd2d5 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.165022 Aug 28 10:28:02.237493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 550/1121] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:02 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:03.259014 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e8a685e0-8613-4862-b37b-17a2611739e5 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:03.259728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e8a685e0-8613-4862-b37b-17a2611739e5 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:03.261910 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=6 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:28:03.268466 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e8a685e0-8613-4862-b37b-17a2611739e5 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:03.269079 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e8a685e0-8613-4862-b37b-17a2611739e5 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:03.269664 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e8a685e0-8613-4862-b37b-17a2611739e5 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:03.270355 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e8a685e0-8613-4862-b37b-17a2611739e5 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:03.270802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e8a685e0-8613-4862-b37b-17a2611739e5 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:03.271220 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e8a685e0-8613-4862-b37b-17a2611739e5 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:03.408555 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e8a685e0-8613-4862-b37b-17a2611739e5 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:03.417010 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e8a685e0-8613-4862-b37b-17a2611739e5 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.162876 Aug 28 10:28:03.417587 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 572/1122] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:03 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:04.442375 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-143fc991-3f77-4238-b2e7-8da9cebe042e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:04.443334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-143fc991-3f77-4238-b2e7-8da9cebe042e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:04.454630 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-143fc991-3f77-4238-b2e7-8da9cebe042e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:04.455380 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-143fc991-3f77-4238-b2e7-8da9cebe042e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:04.456195 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-143fc991-3f77-4238-b2e7-8da9cebe042e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:04.457259 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-143fc991-3f77-4238-b2e7-8da9cebe042e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:04.457696 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-143fc991-3f77-4238-b2e7-8da9cebe042e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:04.458112 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-143fc991-3f77-4238-b2e7-8da9cebe042e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:04.600123 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-143fc991-3f77-4238-b2e7-8da9cebe042e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:04.607742 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-143fc991-3f77-4238-b2e7-8da9cebe042e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.172005 Aug 28 10:28:04.608359 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 551/1123] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:04 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:05.628315 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0dc77df2-fde8-4241-b0e4-d88ca80ecf24 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:05.629032 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0dc77df2-fde8-4241-b0e4-d88ca80ecf24 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:05.635856 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dc77df2-fde8-4241-b0e4-d88ca80ecf24 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:05.636341 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dc77df2-fde8-4241-b0e4-d88ca80ecf24 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:05.636805 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dc77df2-fde8-4241-b0e4-d88ca80ecf24 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:05.637496 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dc77df2-fde8-4241-b0e4-d88ca80ecf24 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:05.637948 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dc77df2-fde8-4241-b0e4-d88ca80ecf24 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:05.638365 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dc77df2-fde8-4241-b0e4-d88ca80ecf24 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:05.766313 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0dc77df2-fde8-4241-b0e4-d88ca80ecf24 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:05.774430 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0dc77df2-fde8-4241-b0e4-d88ca80ecf24 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.150012 Aug 28 10:28:05.774998 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 573/1124] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:05 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:06.794241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-57a212e8-863c-43c7-a085-da7e1fd36b8d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:06.795159 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-57a212e8-863c-43c7-a085-da7e1fd36b8d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:06.802099 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-57a212e8-863c-43c7-a085-da7e1fd36b8d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:06.802581 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-57a212e8-863c-43c7-a085-da7e1fd36b8d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:06.803006 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-57a212e8-863c-43c7-a085-da7e1fd36b8d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:06.803695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-57a212e8-863c-43c7-a085-da7e1fd36b8d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:06.804141 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-57a212e8-863c-43c7-a085-da7e1fd36b8d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:06.804569 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-57a212e8-863c-43c7-a085-da7e1fd36b8d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:06.959263 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-57a212e8-863c-43c7-a085-da7e1fd36b8d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:06.971291 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-57a212e8-863c-43c7-a085-da7e1fd36b8d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.180848 Aug 28 10:28:06.972020 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 552/1125] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:06 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:07.996249 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-50738593-d223-49d9-ae40-1de07aa94f98 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:07.997347 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-50738593-d223-49d9-ae40-1de07aa94f98 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:08.006694 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-50738593-d223-49d9-ae40-1de07aa94f98 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:08.007176 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-50738593-d223-49d9-ae40-1de07aa94f98 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:08.007607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-50738593-d223-49d9-ae40-1de07aa94f98 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:08.008304 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-50738593-d223-49d9-ae40-1de07aa94f98 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:08.008788 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-50738593-d223-49d9-ae40-1de07aa94f98 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:08.009210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-50738593-d223-49d9-ae40-1de07aa94f98 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:08.145085 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-50738593-d223-49d9-ae40-1de07aa94f98 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:08.153219 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-50738593-d223-49d9-ae40-1de07aa94f98 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.163444 Aug 28 10:28:08.153795 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 574/1126] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:07 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:09.178669 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-823c0fe1-1751-4b24-a505-154138c88d0f tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:09.179539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-823c0fe1-1751-4b24-a505-154138c88d0f tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:09.190629 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-823c0fe1-1751-4b24-a505-154138c88d0f tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:09.191471 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-823c0fe1-1751-4b24-a505-154138c88d0f tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:09.191902 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-823c0fe1-1751-4b24-a505-154138c88d0f tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:09.192631 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-823c0fe1-1751-4b24-a505-154138c88d0f tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:09.193088 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-823c0fe1-1751-4b24-a505-154138c88d0f tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:09.193512 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-823c0fe1-1751-4b24-a505-154138c88d0f tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:09.336849 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-823c0fe1-1751-4b24-a505-154138c88d0f tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:09.348257 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-823c0fe1-1751-4b24-a505-154138c88d0f tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.176343 Aug 28 10:28:09.348873 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 553/1127] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:09 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:10.372306 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-629ca8af-c88f-4706-b71e-b783cf9d2a9b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:10.373329 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-629ca8af-c88f-4706-b71e-b783cf9d2a9b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:10.382923 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-629ca8af-c88f-4706-b71e-b783cf9d2a9b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:10.383399 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-629ca8af-c88f-4706-b71e-b783cf9d2a9b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:10.383816 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-629ca8af-c88f-4706-b71e-b783cf9d2a9b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:10.384523 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-629ca8af-c88f-4706-b71e-b783cf9d2a9b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:10.384969 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-629ca8af-c88f-4706-b71e-b783cf9d2a9b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:10.385380 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-629ca8af-c88f-4706-b71e-b783cf9d2a9b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:10.514827 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-629ca8af-c88f-4706-b71e-b783cf9d2a9b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:10.523866 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-629ca8af-c88f-4706-b71e-b783cf9d2a9b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.158056 Aug 28 10:28:10.524441 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 575/1128] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:10 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:11.549244 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-2d2e98bd-ab92-49e0-82c8-8fe716a79b7c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:11.550257 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-2d2e98bd-ab92-49e0-82c8-8fe716a79b7c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:11.558102 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2d2e98bd-ab92-49e0-82c8-8fe716a79b7c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:11.558584 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2d2e98bd-ab92-49e0-82c8-8fe716a79b7c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:11.559018 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2d2e98bd-ab92-49e0-82c8-8fe716a79b7c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:11.559707 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2d2e98bd-ab92-49e0-82c8-8fe716a79b7c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:11.560158 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2d2e98bd-ab92-49e0-82c8-8fe716a79b7c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:11.560609 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2d2e98bd-ab92-49e0-82c8-8fe716a79b7c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:11.693973 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-2d2e98bd-ab92-49e0-82c8-8fe716a79b7c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:11.705511 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-2d2e98bd-ab92-49e0-82c8-8fe716a79b7c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.163129 Aug 28 10:28:11.706312 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 554/1129] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:11 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:12.500313 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-bc995a77-3339-47cd-801a-d2cd684a7545 req-f8691e85-8f96-40f3-923a-8d65d8651264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e63ee84e-611d-4899-a83c-3b95dd818ae2", "tag": "8551ab95-1dbc-4704-8bcd-277aa9ca0c03"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:28:12.510889 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-bc995a77-3339-47cd-801a-d2cd684a7545 req-f8691e85-8f96-40f3-923a-8d65d8651264 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:12.511328 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-bc995a77-3339-47cd-801a-d2cd684a7545 req-f8691e85-8f96-40f3-923a-8d65d8651264 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:12.511962 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-bc995a77-3339-47cd-801a-d2cd684a7545 req-f8691e85-8f96-40f3-923a-8d65d8651264 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:12.524992 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-bc995a77-3339-47cd-801a-d2cd684a7545 req-f8691e85-8f96-40f3-923a-8d65d8651264 service nova] Creating event network-changed:8551ab95-1dbc-4704-8bcd-277aa9ca0c03 for instance e63ee84e-611d-4899-a83c-3b95dd818ae2 on hv-cinder-85200 Aug 28 10:28:12.530055 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-bc995a77-3339-47cd-801a-d2cd684a7545 req-f8691e85-8f96-40f3-923a-8d65d8651264 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159273 Aug 28 10:28:12.530733 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 576/1130] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:28:12.726499 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-2379af01-e361-4187-9b2d-7bd6ee49239d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:12.727105 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-2379af01-e361-4187-9b2d-7bd6ee49239d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:12.734215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2379af01-e361-4187-9b2d-7bd6ee49239d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:12.734691 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2379af01-e361-4187-9b2d-7bd6ee49239d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:12.735116 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2379af01-e361-4187-9b2d-7bd6ee49239d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:12.735802 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2379af01-e361-4187-9b2d-7bd6ee49239d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:12.736247 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2379af01-e361-4187-9b2d-7bd6ee49239d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:12.736698 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2379af01-e361-4187-9b2d-7bd6ee49239d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:12.949258 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-2379af01-e361-4187-9b2d-7bd6ee49239d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:12.957445 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-2379af01-e361-4187-9b2d-7bd6ee49239d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.234993 Aug 28 10:28:12.958013 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 555/1131] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:12 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:13.984560 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dd774550-e7a2-47a9-8842-8297858ba24b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:13.985721 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-dd774550-e7a2-47a9-8842-8297858ba24b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:13.996148 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dd774550-e7a2-47a9-8842-8297858ba24b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:13.996986 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dd774550-e7a2-47a9-8842-8297858ba24b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:13.997689 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dd774550-e7a2-47a9-8842-8297858ba24b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:13.998803 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dd774550-e7a2-47a9-8842-8297858ba24b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:13.999533 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dd774550-e7a2-47a9-8842-8297858ba24b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:14.000219 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dd774550-e7a2-47a9-8842-8297858ba24b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:14.131550 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dd774550-e7a2-47a9-8842-8297858ba24b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:14.139695 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-dd774550-e7a2-47a9-8842-8297858ba24b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.163250 Aug 28 10:28:14.140241 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 577/1132] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:13 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:15.160645 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f7866469-c2ea-4c20-9a99-44c5e94cf6bd tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:15.161205 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f7866469-c2ea-4c20-9a99-44c5e94cf6bd tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:15.167957 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f7866469-c2ea-4c20-9a99-44c5e94cf6bd tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:15.168443 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f7866469-c2ea-4c20-9a99-44c5e94cf6bd tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:15.168896 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f7866469-c2ea-4c20-9a99-44c5e94cf6bd tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:15.169934 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f7866469-c2ea-4c20-9a99-44c5e94cf6bd tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:15.170367 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f7866469-c2ea-4c20-9a99-44c5e94cf6bd tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:15.170838 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f7866469-c2ea-4c20-9a99-44c5e94cf6bd tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:15.300378 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f7866469-c2ea-4c20-9a99-44c5e94cf6bd tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:15.308168 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f7866469-c2ea-4c20-9a99-44c5e94cf6bd tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.151622 Aug 28 10:28:15.308767 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 556/1133] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:15 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:16.329831 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0caea02d-a9c0-4c3f-8284-121d9ae3b7eb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:16.330457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0caea02d-a9c0-4c3f-8284-121d9ae3b7eb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:16.337248 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0caea02d-a9c0-4c3f-8284-121d9ae3b7eb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:16.337724 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0caea02d-a9c0-4c3f-8284-121d9ae3b7eb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:16.338152 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0caea02d-a9c0-4c3f-8284-121d9ae3b7eb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:16.338831 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0caea02d-a9c0-4c3f-8284-121d9ae3b7eb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:16.339275 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0caea02d-a9c0-4c3f-8284-121d9ae3b7eb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:16.339685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0caea02d-a9c0-4c3f-8284-121d9ae3b7eb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:16.492237 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0caea02d-a9c0-4c3f-8284-121d9ae3b7eb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:16.499974 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0caea02d-a9c0-4c3f-8284-121d9ae3b7eb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.174283 Aug 28 10:28:16.500548 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 578/1134] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:16 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:17.524831 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-7b675013-b7dc-4a7d-b772-102b1a90eb11 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:17.525798 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-7b675013-b7dc-4a7d-b772-102b1a90eb11 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:17.537155 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7b675013-b7dc-4a7d-b772-102b1a90eb11 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:17.537959 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7b675013-b7dc-4a7d-b772-102b1a90eb11 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:17.538672 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7b675013-b7dc-4a7d-b772-102b1a90eb11 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:17.539804 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7b675013-b7dc-4a7d-b772-102b1a90eb11 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:17.540582 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7b675013-b7dc-4a7d-b772-102b1a90eb11 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:17.541301 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7b675013-b7dc-4a7d-b772-102b1a90eb11 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:17.684946 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7b675013-b7dc-4a7d-b772-102b1a90eb11 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:17.693291 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-7b675013-b7dc-4a7d-b772-102b1a90eb11 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.175123 Aug 28 10:28:17.693861 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 557/1135] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:17 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:18.718087 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-81cbc7b2-341b-4af4-bc44-28f98f3d8b68 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:18.718931 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-81cbc7b2-341b-4af4-bc44-28f98f3d8b68 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:18.727858 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81cbc7b2-341b-4af4-bc44-28f98f3d8b68 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:18.728335 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81cbc7b2-341b-4af4-bc44-28f98f3d8b68 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:18.728798 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81cbc7b2-341b-4af4-bc44-28f98f3d8b68 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:18.729481 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81cbc7b2-341b-4af4-bc44-28f98f3d8b68 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:18.729923 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81cbc7b2-341b-4af4-bc44-28f98f3d8b68 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:18.730339 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81cbc7b2-341b-4af4-bc44-28f98f3d8b68 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:18.905463 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-81cbc7b2-341b-4af4-bc44-28f98f3d8b68 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:18.914655 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-81cbc7b2-341b-4af4-bc44-28f98f3d8b68 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.203200 Aug 28 10:28:18.915221 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 579/1136] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:18 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:19.939645 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-2159ba19-f26a-46de-80c2-ef72676957fb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:19.940694 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-2159ba19-f26a-46de-80c2-ef72676957fb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:19.951729 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2159ba19-f26a-46de-80c2-ef72676957fb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:19.952643 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2159ba19-f26a-46de-80c2-ef72676957fb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:19.953361 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2159ba19-f26a-46de-80c2-ef72676957fb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:19.954489 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2159ba19-f26a-46de-80c2-ef72676957fb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:19.955236 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2159ba19-f26a-46de-80c2-ef72676957fb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:19.955929 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2159ba19-f26a-46de-80c2-ef72676957fb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:20.098426 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-2159ba19-f26a-46de-80c2-ef72676957fb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:20.110576 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-2159ba19-f26a-46de-80c2-ef72676957fb tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.176822 Aug 28 10:28:20.111389 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 558/1137] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:19 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:21.131619 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-350b000d-e1c8-4cb4-9a7c-c43231a7e481 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:21.132241 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-350b000d-e1c8-4cb4-9a7c-c43231a7e481 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:21.135069 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:28:21.140392 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-350b000d-e1c8-4cb4-9a7c-c43231a7e481 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:21.140939 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-350b000d-e1c8-4cb4-9a7c-c43231a7e481 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:21.141370 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-350b000d-e1c8-4cb4-9a7c-c43231a7e481 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:21.142052 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-350b000d-e1c8-4cb4-9a7c-c43231a7e481 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:21.142488 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-350b000d-e1c8-4cb4-9a7c-c43231a7e481 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:21.142922 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-350b000d-e1c8-4cb4-9a7c-c43231a7e481 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:21.146267 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=69 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:28:21.350664 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-350b000d-e1c8-4cb4-9a7c-c43231a7e481 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:21.358873 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-350b000d-e1c8-4cb4-9a7c-c43231a7e481 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.231333 Aug 28 10:28:21.359466 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 580/1138] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:21 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:22.379545 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-81cfa213-7499-4664-a803-8b5ee3cb1ebf tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:22.380150 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-81cfa213-7499-4664-a803-8b5ee3cb1ebf tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:22.383815 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:28:22.387888 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-81cfa213-7499-4664-a803-8b5ee3cb1ebf tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:22.388395 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-81cfa213-7499-4664-a803-8b5ee3cb1ebf tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:22.388853 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-81cfa213-7499-4664-a803-8b5ee3cb1ebf tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:22.389547 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-81cfa213-7499-4664-a803-8b5ee3cb1ebf tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:22.389995 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-81cfa213-7499-4664-a803-8b5ee3cb1ebf tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:22.390411 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-81cfa213-7499-4664-a803-8b5ee3cb1ebf tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:22.396553 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=81 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:28:22.525274 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-81cfa213-7499-4664-a803-8b5ee3cb1ebf tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:22.534233 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-81cfa213-7499-4664-a803-8b5ee3cb1ebf tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.158486 Aug 28 10:28:22.534932 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 559/1139] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:22 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:23.431694 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-4fa947e7-da47-47f7-ad92-571b9c313370 req-3bf9a85b-ef60-479f-9be8-a2d3c3c9d005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63ee84e-611d-4899-a83c-3b95dd818ae2", "name": "network-vif-plugged", "status": "completed", "tag": "8551ab95-1dbc-4704-8bcd-277aa9ca0c03"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:28:23.442472 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-4fa947e7-da47-47f7-ad92-571b9c313370 req-3bf9a85b-ef60-479f-9be8-a2d3c3c9d005 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:23.443241 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-4fa947e7-da47-47f7-ad92-571b9c313370 req-3bf9a85b-ef60-479f-9be8-a2d3c3c9d005 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:23.443693 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-4fa947e7-da47-47f7-ad92-571b9c313370 req-3bf9a85b-ef60-479f-9be8-a2d3c3c9d005 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:23.455345 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-4fa947e7-da47-47f7-ad92-571b9c313370 req-3bf9a85b-ef60-479f-9be8-a2d3c3c9d005 service nova] Creating event network-vif-plugged:8551ab95-1dbc-4704-8bcd-277aa9ca0c03 for instance e63ee84e-611d-4899-a83c-3b95dd818ae2 on hv-cinder-85200 Aug 28 10:28:23.460430 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-4fa947e7-da47-47f7-ad92-571b9c313370 req-3bf9a85b-ef60-479f-9be8-a2d3c3c9d005 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087796 Aug 28 10:28:23.461230 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 581/1140] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:28:23.556206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-79b3e191-2127-477b-a925-ecb502a1c2cc tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:23.556802 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-79b3e191-2127-477b-a925-ecb502a1c2cc tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:23.565910 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-79b3e191-2127-477b-a925-ecb502a1c2cc tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:23.566393 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-79b3e191-2127-477b-a925-ecb502a1c2cc tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:23.566814 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-79b3e191-2127-477b-a925-ecb502a1c2cc tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:23.567512 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-79b3e191-2127-477b-a925-ecb502a1c2cc tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:23.568060 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-79b3e191-2127-477b-a925-ecb502a1c2cc tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:23.568473 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-79b3e191-2127-477b-a925-ecb502a1c2cc tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:23.738383 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-79b3e191-2127-477b-a925-ecb502a1c2cc tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:23.746861 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-79b3e191-2127-477b-a925-ecb502a1c2cc tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.194658 Aug 28 10:28:23.747428 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 560/1141] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:23 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:24.771279 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1d679965-43bd-48fe-95cf-ed0ac2630242 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:24.772456 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1d679965-43bd-48fe-95cf-ed0ac2630242 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:24.783812 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d679965-43bd-48fe-95cf-ed0ac2630242 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:24.784623 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d679965-43bd-48fe-95cf-ed0ac2630242 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:24.785386 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d679965-43bd-48fe-95cf-ed0ac2630242 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:24.786575 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d679965-43bd-48fe-95cf-ed0ac2630242 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:24.787030 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d679965-43bd-48fe-95cf-ed0ac2630242 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:24.787451 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d679965-43bd-48fe-95cf-ed0ac2630242 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:24.923414 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1d679965-43bd-48fe-95cf-ed0ac2630242 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:24.931377 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1d679965-43bd-48fe-95cf-ed0ac2630242 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1358 microversion: 2.1 time: 0.167098 Aug 28 10:28:24.931995 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 582/1142] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:24 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:25.960435 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-45edbb83-51f7-4d48-b16a-9658d1480687 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:25.961051 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-45edbb83-51f7-4d48-b16a-9658d1480687 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:25.967757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-45edbb83-51f7-4d48-b16a-9658d1480687 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:25.968237 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-45edbb83-51f7-4d48-b16a-9658d1480687 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:25.968704 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-45edbb83-51f7-4d48-b16a-9658d1480687 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:25.969394 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-45edbb83-51f7-4d48-b16a-9658d1480687 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:25.969841 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-45edbb83-51f7-4d48-b16a-9658d1480687 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:25.970262 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-45edbb83-51f7-4d48-b16a-9658d1480687 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:26.358084 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-45edbb83-51f7-4d48-b16a-9658d1480687 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:26.368361 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-45edbb83-51f7-4d48-b16a-9658d1480687 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1549 microversion: 2.1 time: 0.413031 Aug 28 10:28:26.368974 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 561/1143] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:25 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1549 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:26.388188 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8807f626-6175-45a9-adaf-e830b0686052 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:26.388824 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8807f626-6175-45a9-adaf-e830b0686052 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:26.395600 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8807f626-6175-45a9-adaf-e830b0686052 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:26.396173 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8807f626-6175-45a9-adaf-e830b0686052 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:26.396624 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8807f626-6175-45a9-adaf-e830b0686052 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:26.397311 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8807f626-6175-45a9-adaf-e830b0686052 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:26.397754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8807f626-6175-45a9-adaf-e830b0686052 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:26.398164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8807f626-6175-45a9-adaf-e830b0686052 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:26.533271 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8807f626-6175-45a9-adaf-e830b0686052 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:26.544222 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8807f626-6175-45a9-adaf-e830b0686052 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1549 microversion: 2.1 time: 0.159617 Aug 28 10:28:26.545441 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 583/1144] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:26 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1549 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:26.566824 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c2f0dd05-6ef0-4fd8-bc2e-2ec2543a9a53 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:26.571766 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c2f0dd05-6ef0-4fd8-bc2e-2ec2543a9a53 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:26.572547 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c2f0dd05-6ef0-4fd8-bc2e-2ec2543a9a53 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Searching by: {'deleted': False, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385'} {{(pid=120664) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 28 10:28:26.579435 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c2f0dd05-6ef0-4fd8-bc2e-2ec2543a9a53 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:26.579935 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c2f0dd05-6ef0-4fd8-bc2e-2ec2543a9a53 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:26.580360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c2f0dd05-6ef0-4fd8-bc2e-2ec2543a9a53 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:26.581110 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c2f0dd05-6ef0-4fd8-bc2e-2ec2543a9a53 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:26.581552 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c2f0dd05-6ef0-4fd8-bc2e-2ec2543a9a53 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:26.582090 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c2f0dd05-6ef0-4fd8-bc2e-2ec2543a9a53 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:26.671623 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.multi_cell_list [None req-c2f0dd05-6ef0-4fd8-bc2e-2ec2543a9a53 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120664) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 28 10:28:26.769284 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c2f0dd05-6ef0-4fd8-bc2e-2ec2543a9a53 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.206177 Aug 28 10:28:26.769881 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 562/1145] 10.222.0.40 () {58 vars in 1125 bytes} [Sun Aug 28 10:28:26 2022] GET /compute/v2.1/servers => generated 342 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:28:26.781068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c0015be1-1a51-4c28-85b2-660ab3642a56 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:26.781672 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c0015be1-1a51-4c28-85b2-660ab3642a56 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:26.787554 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0015be1-1a51-4c28-85b2-660ab3642a56 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:26.788021 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0015be1-1a51-4c28-85b2-660ab3642a56 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:26.788443 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0015be1-1a51-4c28-85b2-660ab3642a56 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:26.789145 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0015be1-1a51-4c28-85b2-660ab3642a56 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:26.789584 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0015be1-1a51-4c28-85b2-660ab3642a56 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:26.789994 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0015be1-1a51-4c28-85b2-660ab3642a56 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:26.931363 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c0015be1-1a51-4c28-85b2-660ab3642a56 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:26.939078 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c0015be1-1a51-4c28-85b2-660ab3642a56 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1549 microversion: 2.1 time: 0.161826 Aug 28 10:28:26.939646 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 584/1146] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:26 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:29.164369 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f98fb596-3e3f-421b-8dab-df492e08a319 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-616262960", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-413008888", "security_groups": [{"name": "tempest-secgroup-smoke-42242114"}], "block_device_mapping_v2": [{"uuid": "784b898e-778c-4259-bf44-9fb934c61ac0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "90d5e7eb-f02c-47a7-8a0d-74e76461cf4f"}]}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:28:29.284695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.network.neutron [None req-f98fb596-3e3f-421b-8dab-df492e08a319 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] validate_networks() for [('90d5e7eb-f02c-47a7-8a0d-74e76461cf4f', None, None, None, None, None)] {{(pid=120664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 28 10:28:29.679315 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-f98fb596-3e3f-421b-8dab-df492e08a319 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Flavor limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 28 10:28:29.679824 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-f98fb596-3e3f-421b-8dab-df492e08a319 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Image limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 28 10:28:29.680379 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-f98fb596-3e3f-421b-8dab-df492e08a319 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Flavor pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 28 10:28:29.680664 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-f98fb596-3e3f-421b-8dab-df492e08a319 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Image pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 28 10:28:29.681072 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-f98fb596-3e3f-421b-8dab-df492e08a319 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 28 10:28:29.691124 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f98fb596-3e3f-421b-8dab-df492e08a319 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:29.691639 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f98fb596-3e3f-421b-8dab-df492e08a319 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:29.692066 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f98fb596-3e3f-421b-8dab-df492e08a319 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:29.692893 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f98fb596-3e3f-421b-8dab-df492e08a319 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:29.693592 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f98fb596-3e3f-421b-8dab-df492e08a319 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:29.694127 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f98fb596-3e3f-421b-8dab-df492e08a319 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:29.711876 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-f98fb596-3e3f-421b-8dab-df492e08a319 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Getting quotas for project af70fccdef544a499725509ccd8c545f. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:28:29.715980 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-f98fb596-3e3f-421b-8dab-df492e08a319 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Getting quotas for user 3deb7adb33004f1097574470754611ec and project af70fccdef544a499725509ccd8c545f. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:28:29.789875 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f98fb596-3e3f-421b-8dab-df492e08a319 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Going to run 1 instances... {{(pid=120664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 28 10:28:29.792290 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f98fb596-3e3f-421b-8dab-df492e08a319 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='784b898e-778c-4259-bf44-9fb934c61ac0',volume_size=None,volume_type=None)] {{(pid=120664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 28 10:28:29.930325 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f98fb596-3e3f-421b-8dab-df492e08a319 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.769788 Aug 28 10:28:29.936825 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 563/1147] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Aug 28 10:28:29 2022] POST /compute/v2.1/servers => generated 404 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 28 10:28:29.943719 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7bd00fca-de76-462c-a460-95a925a2b9da tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:29.944307 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7bd00fca-de76-462c-a460-95a925a2b9da tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:30.003447 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7bd00fca-de76-462c-a460-95a925a2b9da tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:30.010347 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7bd00fca-de76-462c-a460-95a925a2b9da tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1093 microversion: 2.1 time: 0.071152 Aug 28 10:28:30.011020 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 585/1148] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:29 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:30.634489 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-71e613b3-7243-49ac-a6ad-418366979a9e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5dc8613f-fb73-4821-92b9-49ff42d5fbbe"}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:28:30.636945 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-71e613b3-7243-49ac-a6ad-418366979a9e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:30.643424 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-71e613b3-7243-49ac-a6ad-418366979a9e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:30.643869 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-71e613b3-7243-49ac-a6ad-418366979a9e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:30.644442 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-71e613b3-7243-49ac-a6ad-418366979a9e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:30.645170 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-71e613b3-7243-49ac-a6ad-418366979a9e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:30.645611 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-71e613b3-7243-49ac-a6ad-418366979a9e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:30.646024 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-71e613b3-7243-49ac-a6ad-418366979a9e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:31.032496 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9b2cc108-9fca-4ad9-a652-9ce210c2877b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:31.033146 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9b2cc108-9fca-4ad9-a652-9ce210c2877b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:31.044886 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9b2cc108-9fca-4ad9-a652-9ce210c2877b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:31.045566 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9b2cc108-9fca-4ad9-a652-9ce210c2877b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:31.046182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9b2cc108-9fca-4ad9-a652-9ce210c2877b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:31.047187 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9b2cc108-9fca-4ad9-a652-9ce210c2877b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:31.047848 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9b2cc108-9fca-4ad9-a652-9ce210c2877b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:31.048630 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9b2cc108-9fca-4ad9-a652-9ce210c2877b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:31.111122 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9b2cc108-9fca-4ad9-a652-9ce210c2877b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:31.119016 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9b2cc108-9fca-4ad9-a652-9ce210c2877b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1191 microversion: 2.1 time: 0.092450 Aug 28 10:28:31.119599 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 586/1149] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:31 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1191 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:32.142299 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b02af808-bbf6-48f5-b94f-f8adbf222f15 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:32.143231 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b02af808-bbf6-48f5-b94f-f8adbf222f15 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:32.151476 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b02af808-bbf6-48f5-b94f-f8adbf222f15 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:32.152263 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b02af808-bbf6-48f5-b94f-f8adbf222f15 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:32.152907 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b02af808-bbf6-48f5-b94f-f8adbf222f15 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:32.153831 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b02af808-bbf6-48f5-b94f-f8adbf222f15 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:32.154444 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b02af808-bbf6-48f5-b94f-f8adbf222f15 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:32.155004 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b02af808-bbf6-48f5-b94f-f8adbf222f15 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:32.222129 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b02af808-bbf6-48f5-b94f-f8adbf222f15 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:32.232018 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b02af808-bbf6-48f5-b94f-f8adbf222f15 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1191 microversion: 2.1 time: 0.095302 Aug 28 10:28:32.232607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 587/1150] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:32 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1191 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:32.978026 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-71e613b3-7243-49ac-a6ad-418366979a9e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "POST /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.348011 Aug 28 10:28:32.978888 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 564/1151] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Aug 28 10:28:30 2022] POST /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2/os-volume_attachments => generated 194 bytes in 2350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:28:33.256886 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ed1e4256-53e1-4fc3-b86e-c26b8e624185 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:33.257961 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ed1e4256-53e1-4fc3-b86e-c26b8e624185 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:33.268384 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed1e4256-53e1-4fc3-b86e-c26b8e624185 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:33.269195 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed1e4256-53e1-4fc3-b86e-c26b8e624185 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:33.269888 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed1e4256-53e1-4fc3-b86e-c26b8e624185 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:33.270997 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed1e4256-53e1-4fc3-b86e-c26b8e624185 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:33.271721 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed1e4256-53e1-4fc3-b86e-c26b8e624185 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:33.272408 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed1e4256-53e1-4fc3-b86e-c26b8e624185 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:33.339880 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ed1e4256-53e1-4fc3-b86e-c26b8e624185 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:33.351871 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ed1e4256-53e1-4fc3-b86e-c26b8e624185 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1191 microversion: 2.1 time: 0.101538 Aug 28 10:28:33.352553 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 588/1152] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:33 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1191 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:34.382969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-d31fd3c2-0816-49a5-8922-c97b59bfa53e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:34.383660 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-d31fd3c2-0816-49a5-8922-c97b59bfa53e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:34.390339 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d31fd3c2-0816-49a5-8922-c97b59bfa53e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:34.390824 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d31fd3c2-0816-49a5-8922-c97b59bfa53e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:34.391248 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d31fd3c2-0816-49a5-8922-c97b59bfa53e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:34.391934 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d31fd3c2-0816-49a5-8922-c97b59bfa53e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:34.392383 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d31fd3c2-0816-49a5-8922-c97b59bfa53e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:34.392831 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d31fd3c2-0816-49a5-8922-c97b59bfa53e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:34.454193 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d31fd3c2-0816-49a5-8922-c97b59bfa53e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:34.462222 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-d31fd3c2-0816-49a5-8922-c97b59bfa53e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1191 microversion: 2.1 time: 0.086900 Aug 28 10:28:34.462822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 565/1153] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:34 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1191 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:35.482841 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d9bf47bc-6bc7-4af7-9dc8-2ca30e989e87 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:35.483440 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d9bf47bc-6bc7-4af7-9dc8-2ca30e989e87 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:35.490219 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d9bf47bc-6bc7-4af7-9dc8-2ca30e989e87 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:35.490697 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d9bf47bc-6bc7-4af7-9dc8-2ca30e989e87 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:35.491121 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d9bf47bc-6bc7-4af7-9dc8-2ca30e989e87 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:35.491851 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d9bf47bc-6bc7-4af7-9dc8-2ca30e989e87 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:35.493141 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d9bf47bc-6bc7-4af7-9dc8-2ca30e989e87 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:35.493586 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d9bf47bc-6bc7-4af7-9dc8-2ca30e989e87 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:35.556364 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d9bf47bc-6bc7-4af7-9dc8-2ca30e989e87 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:35.564791 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d9bf47bc-6bc7-4af7-9dc8-2ca30e989e87 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1191 microversion: 2.1 time: 0.085964 Aug 28 10:28:35.566400 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 589/1154] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:35 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:36.589456 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-3cb01b1e-123e-4895-8287-e202e26ddd73 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:36.592443 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-3cb01b1e-123e-4895-8287-e202e26ddd73 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:36.599209 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3cb01b1e-123e-4895-8287-e202e26ddd73 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:36.599803 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3cb01b1e-123e-4895-8287-e202e26ddd73 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:36.600720 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3cb01b1e-123e-4895-8287-e202e26ddd73 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:36.601612 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3cb01b1e-123e-4895-8287-e202e26ddd73 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:36.602054 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3cb01b1e-123e-4895-8287-e202e26ddd73 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:36.602468 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3cb01b1e-123e-4895-8287-e202e26ddd73 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:36.818058 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-3cb01b1e-123e-4895-8287-e202e26ddd73 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:36.825831 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-3cb01b1e-123e-4895-8287-e202e26ddd73 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1275 microversion: 2.1 time: 0.243799 Aug 28 10:28:36.826316 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 566/1155] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:36 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1275 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:37.287770 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-77d01553-61af-402a-a32c-2d3025d9cb50 req-2cb36ca8-96ba-4853-b218-f2440eaf253f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63c1366d-54f7-4160-8e1a-96d551dd184b", "tag": "3847d05c-508c-4228-b2da-1f89bd39eed0"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:28:37.299060 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-77d01553-61af-402a-a32c-2d3025d9cb50 req-2cb36ca8-96ba-4853-b218-f2440eaf253f service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:37.299609 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-77d01553-61af-402a-a32c-2d3025d9cb50 req-2cb36ca8-96ba-4853-b218-f2440eaf253f service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:37.300993 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-77d01553-61af-402a-a32c-2d3025d9cb50 req-2cb36ca8-96ba-4853-b218-f2440eaf253f service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:37.313136 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-77d01553-61af-402a-a32c-2d3025d9cb50 req-2cb36ca8-96ba-4853-b218-f2440eaf253f service nova] Creating event network-changed:3847d05c-508c-4228-b2da-1f89bd39eed0 for instance 63c1366d-54f7-4160-8e1a-96d551dd184b on hv-cinder-85200 Aug 28 10:28:37.319325 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-77d01553-61af-402a-a32c-2d3025d9cb50 req-2cb36ca8-96ba-4853-b218-f2440eaf253f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035046 Aug 28 10:28:37.320179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 590/1156] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:28:37.847576 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-d6f68b50-9c1a-4800-8290-22e321dc4ba8 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:37.848133 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-d6f68b50-9c1a-4800-8290-22e321dc4ba8 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:37.855143 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d6f68b50-9c1a-4800-8290-22e321dc4ba8 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:37.855672 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d6f68b50-9c1a-4800-8290-22e321dc4ba8 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:37.856106 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d6f68b50-9c1a-4800-8290-22e321dc4ba8 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:37.856830 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d6f68b50-9c1a-4800-8290-22e321dc4ba8 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:37.857280 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d6f68b50-9c1a-4800-8290-22e321dc4ba8 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:37.857701 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d6f68b50-9c1a-4800-8290-22e321dc4ba8 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:38.062045 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d6f68b50-9c1a-4800-8290-22e321dc4ba8 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:38.070197 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-d6f68b50-9c1a-4800-8290-22e321dc4ba8 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1275 microversion: 2.1 time: 0.226645 Aug 28 10:28:38.070781 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 567/1157] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:37 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1275 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:39.097007 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ceecbd53-8652-4a0f-aa2e-8e12c7a10f07 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:39.098164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ceecbd53-8652-4a0f-aa2e-8e12c7a10f07 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:39.108607 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ceecbd53-8652-4a0f-aa2e-8e12c7a10f07 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:39.109437 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ceecbd53-8652-4a0f-aa2e-8e12c7a10f07 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:39.110154 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ceecbd53-8652-4a0f-aa2e-8e12c7a10f07 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:39.111292 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ceecbd53-8652-4a0f-aa2e-8e12c7a10f07 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:39.112033 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ceecbd53-8652-4a0f-aa2e-8e12c7a10f07 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:39.112776 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ceecbd53-8652-4a0f-aa2e-8e12c7a10f07 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:39.250217 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ceecbd53-8652-4a0f-aa2e-8e12c7a10f07 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:39.258530 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ceecbd53-8652-4a0f-aa2e-8e12c7a10f07 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1275 microversion: 2.1 time: 0.169353 Aug 28 10:28:39.259081 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 591/1158] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:39 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1275 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:40.286586 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-582c90cb-6d32-45e8-b202-81b80a83106d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:40.287392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-582c90cb-6d32-45e8-b202-81b80a83106d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:40.290496 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=4 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:28:40.291345 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=6 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:28:40.298072 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-582c90cb-6d32-45e8-b202-81b80a83106d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:40.298549 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-582c90cb-6d32-45e8-b202-81b80a83106d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:40.298975 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-582c90cb-6d32-45e8-b202-81b80a83106d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:40.299660 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-582c90cb-6d32-45e8-b202-81b80a83106d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:40.300104 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-582c90cb-6d32-45e8-b202-81b80a83106d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:40.300541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-582c90cb-6d32-45e8-b202-81b80a83106d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:40.434757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-582c90cb-6d32-45e8-b202-81b80a83106d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:40.443085 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-582c90cb-6d32-45e8-b202-81b80a83106d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1275 microversion: 2.1 time: 0.161672 Aug 28 10:28:40.443724 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 568/1159] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:40 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1275 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:41.465679 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8271b0e7-2c15-4f77-93ce-40c84c7f20c1 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:41.466281 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8271b0e7-2c15-4f77-93ce-40c84c7f20c1 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:41.468208 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:28:41.474154 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8271b0e7-2c15-4f77-93ce-40c84c7f20c1 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:41.474622 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8271b0e7-2c15-4f77-93ce-40c84c7f20c1 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:41.475043 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8271b0e7-2c15-4f77-93ce-40c84c7f20c1 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:41.475720 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8271b0e7-2c15-4f77-93ce-40c84c7f20c1 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:41.476157 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8271b0e7-2c15-4f77-93ce-40c84c7f20c1 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:41.476568 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8271b0e7-2c15-4f77-93ce-40c84c7f20c1 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:41.618182 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8271b0e7-2c15-4f77-93ce-40c84c7f20c1 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:41.626149 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8271b0e7-2c15-4f77-93ce-40c84c7f20c1 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1275 microversion: 2.1 time: 0.164531 Aug 28 10:28:41.626730 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 592/1160] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:41 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:42.648883 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-5e6e2b07-4421-4ded-b795-5def4dacb23c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:42.649617 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-5e6e2b07-4421-4ded-b795-5def4dacb23c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:42.658904 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5e6e2b07-4421-4ded-b795-5def4dacb23c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:42.659576 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5e6e2b07-4421-4ded-b795-5def4dacb23c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:42.660206 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5e6e2b07-4421-4ded-b795-5def4dacb23c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:42.661253 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5e6e2b07-4421-4ded-b795-5def4dacb23c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:42.661905 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5e6e2b07-4421-4ded-b795-5def4dacb23c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:42.662495 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5e6e2b07-4421-4ded-b795-5def4dacb23c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:42.811518 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-5e6e2b07-4421-4ded-b795-5def4dacb23c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:42.819396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-5e6e2b07-4421-4ded-b795-5def4dacb23c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1275 microversion: 2.1 time: 0.176370 Aug 28 10:28:42.819968 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 569/1161] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:42 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1275 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:43.838922 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dfe8fe5c-9fc3-4860-b622-239ef3b1ce2f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:43.840233 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-dfe8fe5c-9fc3-4860-b622-239ef3b1ce2f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:43.847304 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfe8fe5c-9fc3-4860-b622-239ef3b1ce2f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:43.848155 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfe8fe5c-9fc3-4860-b622-239ef3b1ce2f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:43.848780 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfe8fe5c-9fc3-4860-b622-239ef3b1ce2f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:43.849909 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfe8fe5c-9fc3-4860-b622-239ef3b1ce2f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:43.850731 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfe8fe5c-9fc3-4860-b622-239ef3b1ce2f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:43.851706 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfe8fe5c-9fc3-4860-b622-239ef3b1ce2f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:44.049509 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dfe8fe5c-9fc3-4860-b622-239ef3b1ce2f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:44.058211 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-dfe8fe5c-9fc3-4860-b622-239ef3b1ce2f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1275 microversion: 2.1 time: 0.222986 Aug 28 10:28:44.059284 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 593/1162] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:43 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1275 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:44.853315 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-1d6d3dd4-f19d-414c-b43e-8534730ae42c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:44.853907 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-1d6d3dd4-f19d-414c-b43e-8534730ae42c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:44.860668 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1d6d3dd4-f19d-414c-b43e-8534730ae42c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:44.861151 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1d6d3dd4-f19d-414c-b43e-8534730ae42c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:44.861583 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1d6d3dd4-f19d-414c-b43e-8534730ae42c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:44.862305 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1d6d3dd4-f19d-414c-b43e-8534730ae42c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:44.862736 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1d6d3dd4-f19d-414c-b43e-8534730ae42c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:44.863189 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1d6d3dd4-f19d-414c-b43e-8534730ae42c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:44.993580 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-1d6d3dd4-f19d-414c-b43e-8534730ae42c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:45.002072 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-1d6d3dd4-f19d-414c-b43e-8534730ae42c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1595 microversion: 2.1 time: 0.152647 Aug 28 10:28:45.002642 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 570/1163] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:44 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1595 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:45.082151 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c5511a2e-081d-4a00-9dd8-787a9a869734 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:45.082853 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c5511a2e-081d-4a00-9dd8-787a9a869734 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:45.089668 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c5511a2e-081d-4a00-9dd8-787a9a869734 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:45.090159 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c5511a2e-081d-4a00-9dd8-787a9a869734 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:45.090640 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c5511a2e-081d-4a00-9dd8-787a9a869734 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:45.091336 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c5511a2e-081d-4a00-9dd8-787a9a869734 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:45.091784 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c5511a2e-081d-4a00-9dd8-787a9a869734 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:45.092202 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c5511a2e-081d-4a00-9dd8-787a9a869734 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:45.241877 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c5511a2e-081d-4a00-9dd8-787a9a869734 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:45.249796 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c5511a2e-081d-4a00-9dd8-787a9a869734 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1263 microversion: 2.1 time: 0.171573 Aug 28 10:28:45.250344 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 594/1164] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:45 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1263 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:45.846954 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-867b445e-815a-4b5d-af16-bd3971409123 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-22811349", "imageRef": "2780c39b-8bd3-4e73-9669-2b2e29474f3e", "flavorRef": "452"}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:28:45.899069 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.network.neutron [None req-867b445e-815a-4b5d-af16-bd3971409123 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] validate_networks() for None {{(pid=120664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 28 10:28:46.271025 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bc6b97c8-3d84-4eb0-8c9c-1529f06828e0 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:46.271627 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bc6b97c8-3d84-4eb0-8c9c-1529f06828e0 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:46.278488 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc6b97c8-3d84-4eb0-8c9c-1529f06828e0 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:46.278972 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc6b97c8-3d84-4eb0-8c9c-1529f06828e0 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:46.279404 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc6b97c8-3d84-4eb0-8c9c-1529f06828e0 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:46.280210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc6b97c8-3d84-4eb0-8c9c-1529f06828e0 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:46.280704 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc6b97c8-3d84-4eb0-8c9c-1529f06828e0 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:46.281116 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc6b97c8-3d84-4eb0-8c9c-1529f06828e0 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:46.594168 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bc6b97c8-3d84-4eb0-8c9c-1529f06828e0 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:46.602620 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bc6b97c8-3d84-4eb0-8c9c-1529f06828e0 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1263 microversion: 2.1 time: 0.335657 Aug 28 10:28:46.603286 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 595/1165] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:46 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1263 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:46.637418 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-867b445e-815a-4b5d-af16-bd3971409123 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Flavor limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 28 10:28:46.637863 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-867b445e-815a-4b5d-af16-bd3971409123 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Image limits 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 28 10:28:46.638341 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-867b445e-815a-4b5d-af16-bd3971409123 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Flavor pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 28 10:28:46.638747 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-867b445e-815a-4b5d-af16-bd3971409123 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Image pref 0:0:0 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 28 10:28:46.639181 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.virt.hardware [None req-867b445e-815a-4b5d-af16-bd3971409123 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 28 10:28:46.648094 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-867b445e-815a-4b5d-af16-bd3971409123 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:46.648579 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-867b445e-815a-4b5d-af16-bd3971409123 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:46.649039 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-867b445e-815a-4b5d-af16-bd3971409123 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:46.649760 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-867b445e-815a-4b5d-af16-bd3971409123 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:46.650210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-867b445e-815a-4b5d-af16-bd3971409123 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:46.650602 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-867b445e-815a-4b5d-af16-bd3971409123 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:46.668078 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-867b445e-815a-4b5d-af16-bd3971409123 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Getting quotas for project d011dbdfa9074d418d341f1d23991844. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 28 10:28:46.672904 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.quota [None req-867b445e-815a-4b5d-af16-bd3971409123 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Getting quotas for user c3c27f3d5edb4eb08546ccda853de534 and project d011dbdfa9074d418d341f1d23991844. Resources: {'instances', 'cores', 'ram'} {{(pid=120664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 28 10:28:46.684193 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-867b445e-815a-4b5d-af16-bd3971409123 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Going to run 1 instances... {{(pid=120664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 28 10:28:46.686577 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-867b445e-815a-4b5d-af16-bd3971409123 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] [instance: 0a42c5d2-a943-4121-bdd8-2b982a384214] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2780c39b-8bd3-4e73-9669-2b2e29474f3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 28 10:28:46.734845 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-867b445e-815a-4b5d-af16-bd3971409123 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.891911 Aug 28 10:28:46.736764 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 571/1166] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Aug 28 10:28:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 28 10:28:46.746725 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-391877ad-c406-4393-8721-5b1b2cb421e9 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:46.747334 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-391877ad-c406-4393-8721-5b1b2cb421e9 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] [instance: 0a42c5d2-a943-4121-bdd8-2b982a384214] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:46.815898 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-391877ad-c406-4393-8721-5b1b2cb421e9 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c27f3d5edb4eb08546ccda853de534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd011dbdfa9074d418d341f1d23991844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:46.823227 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-391877ad-c406-4393-8721-5b1b2cb421e9 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] 10.222.0.40 "GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214" status: 200 len: 1213 microversion: 2.1 time: 0.080492 Aug 28 10:28:46.823880 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 596/1167] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:46 2022] GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:47.406893 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-ad45656e-fdb3-4e1c-b0f0-434bf3734eb5 req-a9783134-8a15-4baf-bbfc-f14ff88908e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e63ee84e-611d-4899-a83c-3b95dd818ae2", "tag": "8551ab95-1dbc-4704-8bcd-277aa9ca0c03"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:28:47.420210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-ad45656e-fdb3-4e1c-b0f0-434bf3734eb5 req-a9783134-8a15-4baf-bbfc-f14ff88908e9 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:47.420896 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-ad45656e-fdb3-4e1c-b0f0-434bf3734eb5 req-a9783134-8a15-4baf-bbfc-f14ff88908e9 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:47.421415 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-ad45656e-fdb3-4e1c-b0f0-434bf3734eb5 req-a9783134-8a15-4baf-bbfc-f14ff88908e9 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:47.433896 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-ad45656e-fdb3-4e1c-b0f0-434bf3734eb5 req-a9783134-8a15-4baf-bbfc-f14ff88908e9 service nova] Creating event network-changed:8551ab95-1dbc-4704-8bcd-277aa9ca0c03 for instance e63ee84e-611d-4899-a83c-3b95dd818ae2 on hv-cinder-85200 Aug 28 10:28:47.439790 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-ad45656e-fdb3-4e1c-b0f0-434bf3734eb5 req-a9783134-8a15-4baf-bbfc-f14ff88908e9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037638 Aug 28 10:28:47.444561 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 572/1168] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:28:47.623449 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3eb53243-e780-4352-873b-1c2b93cc1a62 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:47.624140 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3eb53243-e780-4352-873b-1c2b93cc1a62 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:47.632850 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3eb53243-e780-4352-873b-1c2b93cc1a62 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:47.633336 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3eb53243-e780-4352-873b-1c2b93cc1a62 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:47.633769 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3eb53243-e780-4352-873b-1c2b93cc1a62 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:47.634468 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3eb53243-e780-4352-873b-1c2b93cc1a62 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:47.634914 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3eb53243-e780-4352-873b-1c2b93cc1a62 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:47.635325 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3eb53243-e780-4352-873b-1c2b93cc1a62 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:47.814336 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3eb53243-e780-4352-873b-1c2b93cc1a62 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:47.822239 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3eb53243-e780-4352-873b-1c2b93cc1a62 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1263 microversion: 2.1 time: 0.202708 Aug 28 10:28:47.823054 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 597/1169] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:47 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1263 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:47.844147 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-33703877-f7c0-4076-9b22-0852d16d1c0c tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:47.844802 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-33703877-f7c0-4076-9b22-0852d16d1c0c tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] [instance: 0a42c5d2-a943-4121-bdd8-2b982a384214] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:47.853541 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-33703877-f7c0-4076-9b22-0852d16d1c0c tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:47.854047 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-33703877-f7c0-4076-9b22-0852d16d1c0c tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:47.854750 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-33703877-f7c0-4076-9b22-0852d16d1c0c tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:47.855612 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-33703877-f7c0-4076-9b22-0852d16d1c0c tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:47.856057 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-33703877-f7c0-4076-9b22-0852d16d1c0c tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:47.856470 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-33703877-f7c0-4076-9b22-0852d16d1c0c tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:47.937319 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-33703877-f7c0-4076-9b22-0852d16d1c0c tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c27f3d5edb4eb08546ccda853de534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd011dbdfa9074d418d341f1d23991844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:47.945584 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-33703877-f7c0-4076-9b22-0852d16d1c0c tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] 10.222.0.40 "GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214" status: 200 len: 1265 microversion: 2.1 time: 0.105990 Aug 28 10:28:47.946438 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 573/1170] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:47 2022] GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214 => generated 1265 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:48.759016 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-86fe4e31-9325-4ac5-8841-9759cf9d5c3b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-336798658"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:28:48.759612 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-86fe4e31-9325-4ac5-8841-9759cf9d5c3b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:48.766410 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86fe4e31-9325-4ac5-8841-9759cf9d5c3b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:48.766883 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86fe4e31-9325-4ac5-8841-9759cf9d5c3b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:48.767530 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86fe4e31-9325-4ac5-8841-9759cf9d5c3b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:48.768452 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86fe4e31-9325-4ac5-8841-9759cf9d5c3b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:48.768941 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86fe4e31-9325-4ac5-8841-9759cf9d5c3b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:48.769356 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86fe4e31-9325-4ac5-8841-9759cf9d5c3b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:48.843701 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-fbf8c563-d346-485f-bdcb-d573654fec7f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:48.844306 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-fbf8c563-d346-485f-bdcb-d573654fec7f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:48.851484 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fbf8c563-d346-485f-bdcb-d573654fec7f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:48.851963 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fbf8c563-d346-485f-bdcb-d573654fec7f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:48.852381 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fbf8c563-d346-485f-bdcb-d573654fec7f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:48.853091 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fbf8c563-d346-485f-bdcb-d573654fec7f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:48.860925 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fbf8c563-d346-485f-bdcb-d573654fec7f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:48.867099 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fbf8c563-d346-485f-bdcb-d573654fec7f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:48.949752 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.network.security_group_api [None req-86fe4e31-9325-4ac5-8841-9759cf9d5c3b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Adding security group 79f90cea-155c-4021-91e2-ea47dda721f5 to port 8551ab95-1dbc-4704-8bcd-277aa9ca0c03 Aug 28 10:28:49.094163 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-fbf8c563-d346-485f-bdcb-d573654fec7f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:49.102288 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-fbf8c563-d346-485f-bdcb-d573654fec7f tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1263 microversion: 2.1 time: 0.263044 Aug 28 10:28:49.103241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 574/1171] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:48 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1263 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 28 10:28:49.108017 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-ce7c3a7a-2499-4342-abc4-e631f2af71eb tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:49.108988 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-ce7c3a7a-2499-4342-abc4-e631f2af71eb tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] [instance: 0a42c5d2-a943-4121-bdd8-2b982a384214] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:49.115546 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ce7c3a7a-2499-4342-abc4-e631f2af71eb tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:49.116020 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ce7c3a7a-2499-4342-abc4-e631f2af71eb tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:49.121084 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ce7c3a7a-2499-4342-abc4-e631f2af71eb tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:49.121896 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ce7c3a7a-2499-4342-abc4-e631f2af71eb tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:49.122360 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ce7c3a7a-2499-4342-abc4-e631f2af71eb tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:49.122838 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-ce7c3a7a-2499-4342-abc4-e631f2af71eb tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:49.330965 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-ce7c3a7a-2499-4342-abc4-e631f2af71eb tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c27f3d5edb4eb08546ccda853de534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd011dbdfa9074d418d341f1d23991844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:49.340685 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-ce7c3a7a-2499-4342-abc4-e631f2af71eb tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] 10.222.0.40 "GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214" status: 200 len: 1313 microversion: 2.1 time: 0.236154 Aug 28 10:28:49.341381 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 575/1172] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:49 2022] GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:49.399365 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-86fe4e31-9325-4ac5-8841-9759cf9d5c3b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "POST /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2/action" status: 202 len: 0 microversion: 2.1 time: 0.644240 Aug 28 10:28:49.400175 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 598/1173] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Aug 28 10:28:48 2022] POST /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2/action => generated 0 bytes in 646 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:28:49.408298 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8877c3cf-58a6-4dad-91c8-1e6efa127a10 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:49.408937 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-8877c3cf-58a6-4dad-91c8-1e6efa127a10 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:49.415317 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8877c3cf-58a6-4dad-91c8-1e6efa127a10 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:49.416282 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8877c3cf-58a6-4dad-91c8-1e6efa127a10 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:49.417088 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8877c3cf-58a6-4dad-91c8-1e6efa127a10 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:49.418105 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8877c3cf-58a6-4dad-91c8-1e6efa127a10 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:49.418772 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8877c3cf-58a6-4dad-91c8-1e6efa127a10 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:49.420035 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8877c3cf-58a6-4dad-91c8-1e6efa127a10 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:49.425916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:28:49.458692 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-7760ef78-1077-4bc5-ac52-c34da219b871 req-f9288d7c-3fd7-4320-9120-1ec072be3343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e63ee84e-611d-4899-a83c-3b95dd818ae2", "tag": "8551ab95-1dbc-4704-8bcd-277aa9ca0c03"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:28:49.469243 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7760ef78-1077-4bc5-ac52-c34da219b871 req-f9288d7c-3fd7-4320-9120-1ec072be3343 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:49.469838 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7760ef78-1077-4bc5-ac52-c34da219b871 req-f9288d7c-3fd7-4320-9120-1ec072be3343 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:49.470358 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7760ef78-1077-4bc5-ac52-c34da219b871 req-f9288d7c-3fd7-4320-9120-1ec072be3343 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:49.482122 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-7760ef78-1077-4bc5-ac52-c34da219b871 req-f9288d7c-3fd7-4320-9120-1ec072be3343 service nova] Creating event network-changed:8551ab95-1dbc-4704-8bcd-277aa9ca0c03 for instance e63ee84e-611d-4899-a83c-3b95dd818ae2 on hv-cinder-85200 Aug 28 10:28:49.493627 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-7760ef78-1077-4bc5-ac52-c34da219b871 req-f9288d7c-3fd7-4320-9120-1ec072be3343 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035271 Aug 28 10:28:49.497385 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 599/1174] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:28:49.594697 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8877c3cf-58a6-4dad-91c8-1e6efa127a10 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:49.607896 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-8877c3cf-58a6-4dad-91c8-1e6efa127a10 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1760 microversion: 2.1 time: 0.202792 Aug 28 10:28:49.608722 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 576/1175] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:49 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1760 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:50.125473 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-24caf83b-ec94-470c-b56c-902d48bf6033 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:50.126793 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-24caf83b-ec94-470c-b56c-902d48bf6033 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:50.137977 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24caf83b-ec94-470c-b56c-902d48bf6033 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:50.139627 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24caf83b-ec94-470c-b56c-902d48bf6033 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:50.140110 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24caf83b-ec94-470c-b56c-902d48bf6033 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:50.140911 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24caf83b-ec94-470c-b56c-902d48bf6033 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:50.142249 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24caf83b-ec94-470c-b56c-902d48bf6033 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:50.142920 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-24caf83b-ec94-470c-b56c-902d48bf6033 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:50.143795 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-cc06d1e5-9108-4977-af58-4e91112a4116 req-9e707bec-df74-4be3-bd00-97a9fa82ad81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a42c5d2-a943-4121-bdd8-2b982a384214", "tag": "22c87a25-4921-47f5-8135-2dbfe7207e77"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:28:50.157568 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-cc06d1e5-9108-4977-af58-4e91112a4116 req-9e707bec-df74-4be3-bd00-97a9fa82ad81 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:50.158035 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-cc06d1e5-9108-4977-af58-4e91112a4116 req-9e707bec-df74-4be3-bd00-97a9fa82ad81 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:50.158455 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-cc06d1e5-9108-4977-af58-4e91112a4116 req-9e707bec-df74-4be3-bd00-97a9fa82ad81 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:50.185143 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-cc06d1e5-9108-4977-af58-4e91112a4116 req-9e707bec-df74-4be3-bd00-97a9fa82ad81 service nova] Creating event network-changed:22c87a25-4921-47f5-8135-2dbfe7207e77 for instance 0a42c5d2-a943-4121-bdd8-2b982a384214 on hv-cinder-85200 Aug 28 10:28:50.192706 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-cc06d1e5-9108-4977-af58-4e91112a4116 req-9e707bec-df74-4be3-bd00-97a9fa82ad81 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217569 Aug 28 10:28:50.193979 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 600/1176] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:28:50.294818 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-24caf83b-ec94-470c-b56c-902d48bf6033 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:50.302613 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-24caf83b-ec94-470c-b56c-902d48bf6033 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1263 microversion: 2.1 time: 0.181947 Aug 28 10:28:50.315496 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 577/1177] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:50 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1263 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:50.364084 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-928c0402-a11e-4e11-931d-2f54787ebb7d tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:50.364801 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-928c0402-a11e-4e11-931d-2f54787ebb7d tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] [instance: 0a42c5d2-a943-4121-bdd8-2b982a384214] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:50.371210 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-928c0402-a11e-4e11-931d-2f54787ebb7d tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:50.371932 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-928c0402-a11e-4e11-931d-2f54787ebb7d tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:50.372742 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-928c0402-a11e-4e11-931d-2f54787ebb7d tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:50.373887 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-928c0402-a11e-4e11-931d-2f54787ebb7d tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:50.374807 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-928c0402-a11e-4e11-931d-2f54787ebb7d tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:50.375363 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-928c0402-a11e-4e11-931d-2f54787ebb7d tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:50.526570 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-928c0402-a11e-4e11-931d-2f54787ebb7d tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c27f3d5edb4eb08546ccda853de534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd011dbdfa9074d418d341f1d23991844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:50.529019 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:28:50.536788 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-928c0402-a11e-4e11-931d-2f54787ebb7d tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] 10.222.0.40 "GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214" status: 200 len: 1313 microversion: 2.1 time: 0.176615 Aug 28 10:28:50.537384 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 601/1178] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:50 2022] GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:51.323328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-fdfaf5ed-aa31-4793-8881-acdbb40e386c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:51.323929 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-fdfaf5ed-aa31-4793-8881-acdbb40e386c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:51.331252 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fdfaf5ed-aa31-4793-8881-acdbb40e386c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:51.331825 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fdfaf5ed-aa31-4793-8881-acdbb40e386c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:51.332319 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fdfaf5ed-aa31-4793-8881-acdbb40e386c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:51.333135 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fdfaf5ed-aa31-4793-8881-acdbb40e386c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:51.333666 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fdfaf5ed-aa31-4793-8881-acdbb40e386c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:51.334147 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fdfaf5ed-aa31-4793-8881-acdbb40e386c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:51.478271 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-fdfaf5ed-aa31-4793-8881-acdbb40e386c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:51.490718 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-fdfaf5ed-aa31-4793-8881-acdbb40e386c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1263 microversion: 2.1 time: 0.171075 Aug 28 10:28:51.491494 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 578/1179] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:51 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1263 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:51.559329 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cd16ed3e-2fc8-4ce1-9ab7-9fd2c9f7da36 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:51.560136 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cd16ed3e-2fc8-4ce1-9ab7-9fd2c9f7da36 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] [instance: 0a42c5d2-a943-4121-bdd8-2b982a384214] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:51.562812 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=48 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:28:51.568231 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cd16ed3e-2fc8-4ce1-9ab7-9fd2c9f7da36 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:51.568750 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cd16ed3e-2fc8-4ce1-9ab7-9fd2c9f7da36 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:51.569179 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cd16ed3e-2fc8-4ce1-9ab7-9fd2c9f7da36 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:51.569878 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cd16ed3e-2fc8-4ce1-9ab7-9fd2c9f7da36 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:51.570325 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cd16ed3e-2fc8-4ce1-9ab7-9fd2c9f7da36 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:51.570771 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cd16ed3e-2fc8-4ce1-9ab7-9fd2c9f7da36 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:51.714063 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cd16ed3e-2fc8-4ce1-9ab7-9fd2c9f7da36 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c27f3d5edb4eb08546ccda853de534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd011dbdfa9074d418d341f1d23991844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:51.722398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cd16ed3e-2fc8-4ce1-9ab7-9fd2c9f7da36 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] 10.222.0.40 "GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214" status: 200 len: 1313 microversion: 2.1 time: 0.168530 Aug 28 10:28:51.722990 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 602/1180] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:51 2022] GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:52.516230 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-6b27faab-9e99-467c-923b-bcbd75e5e492 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:52.516912 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-6b27faab-9e99-467c-923b-bcbd75e5e492 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:52.519475 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=6 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:28:52.525394 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6b27faab-9e99-467c-923b-bcbd75e5e492 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:52.525915 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6b27faab-9e99-467c-923b-bcbd75e5e492 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:52.526384 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6b27faab-9e99-467c-923b-bcbd75e5e492 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:52.527131 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6b27faab-9e99-467c-923b-bcbd75e5e492 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:52.527619 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6b27faab-9e99-467c-923b-bcbd75e5e492 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:52.528054 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6b27faab-9e99-467c-923b-bcbd75e5e492 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:52.660817 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-6b27faab-9e99-467c-923b-bcbd75e5e492 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:52.668779 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-6b27faab-9e99-467c-923b-bcbd75e5e492 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1263 microversion: 2.1 time: 0.158732 Aug 28 10:28:52.669741 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 579/1181] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:52 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:52.744873 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bce35057-bfd0-4c05-a27a-20e379a914c0 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:52.745644 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bce35057-bfd0-4c05-a27a-20e379a914c0 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] [instance: 0a42c5d2-a943-4121-bdd8-2b982a384214] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:52.753429 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bce35057-bfd0-4c05-a27a-20e379a914c0 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:52.753912 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bce35057-bfd0-4c05-a27a-20e379a914c0 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:52.754342 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bce35057-bfd0-4c05-a27a-20e379a914c0 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:52.755038 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bce35057-bfd0-4c05-a27a-20e379a914c0 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:52.755550 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bce35057-bfd0-4c05-a27a-20e379a914c0 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:52.755971 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bce35057-bfd0-4c05-a27a-20e379a914c0 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:52.885138 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bce35057-bfd0-4c05-a27a-20e379a914c0 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c27f3d5edb4eb08546ccda853de534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd011dbdfa9074d418d341f1d23991844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:52.897094 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bce35057-bfd0-4c05-a27a-20e379a914c0 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] 10.222.0.40 "GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214" status: 200 len: 1313 microversion: 2.1 time: 0.156725 Aug 28 10:28:52.897921 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 603/1182] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:52 2022] GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:53.690074 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-43ae0ab1-7db0-442b-b23d-ac70b891f9a7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:53.690647 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-43ae0ab1-7db0-442b-b23d-ac70b891f9a7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:53.697665 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-43ae0ab1-7db0-442b-b23d-ac70b891f9a7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:53.698162 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-43ae0ab1-7db0-442b-b23d-ac70b891f9a7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:53.698578 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-43ae0ab1-7db0-442b-b23d-ac70b891f9a7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:53.699288 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-43ae0ab1-7db0-442b-b23d-ac70b891f9a7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:53.699735 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-43ae0ab1-7db0-442b-b23d-ac70b891f9a7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:53.700180 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-43ae0ab1-7db0-442b-b23d-ac70b891f9a7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:53.835828 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-43ae0ab1-7db0-442b-b23d-ac70b891f9a7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:53.844105 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-43ae0ab1-7db0-442b-b23d-ac70b891f9a7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1263 microversion: 2.1 time: 0.157796 Aug 28 10:28:53.845015 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 580/1183] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:53 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:53.922478 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3d0720fa-83d1-498d-bfa1-cb154ae34ad1 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:53.923124 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3d0720fa-83d1-498d-bfa1-cb154ae34ad1 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] [instance: 0a42c5d2-a943-4121-bdd8-2b982a384214] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:53.930031 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3d0720fa-83d1-498d-bfa1-cb154ae34ad1 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:53.930508 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3d0720fa-83d1-498d-bfa1-cb154ae34ad1 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:53.930933 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3d0720fa-83d1-498d-bfa1-cb154ae34ad1 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:53.931611 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3d0720fa-83d1-498d-bfa1-cb154ae34ad1 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:53.932047 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3d0720fa-83d1-498d-bfa1-cb154ae34ad1 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:53.932457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3d0720fa-83d1-498d-bfa1-cb154ae34ad1 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:54.066198 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3d0720fa-83d1-498d-bfa1-cb154ae34ad1 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c27f3d5edb4eb08546ccda853de534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd011dbdfa9074d418d341f1d23991844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:54.073906 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3d0720fa-83d1-498d-bfa1-cb154ae34ad1 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] 10.222.0.40 "GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214" status: 200 len: 1313 microversion: 2.1 time: 0.158344 Aug 28 10:28:54.074464 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 604/1184] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:53 2022] GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:54.865102 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-5827337b-9919-4065-8b01-a6c506ad04ab tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:54.865620 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-5827337b-9919-4065-8b01-a6c506ad04ab tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:54.872337 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5827337b-9919-4065-8b01-a6c506ad04ab tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:54.873182 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5827337b-9919-4065-8b01-a6c506ad04ab tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:54.873606 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5827337b-9919-4065-8b01-a6c506ad04ab tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:54.874969 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5827337b-9919-4065-8b01-a6c506ad04ab tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:54.875424 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5827337b-9919-4065-8b01-a6c506ad04ab tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:54.875842 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-5827337b-9919-4065-8b01-a6c506ad04ab tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:55.011445 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-5827337b-9919-4065-8b01-a6c506ad04ab tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:55.023283 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-5827337b-9919-4065-8b01-a6c506ad04ab tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1263 microversion: 2.1 time: 0.162042 Aug 28 10:28:55.024011 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 581/1185] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:54 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:55.099394 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-631613d4-6c18-4ca5-acec-cb8d98a6392a tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:55.100360 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-631613d4-6c18-4ca5-acec-cb8d98a6392a tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] [instance: 0a42c5d2-a943-4121-bdd8-2b982a384214] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:55.111387 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-631613d4-6c18-4ca5-acec-cb8d98a6392a tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:55.112316 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-631613d4-6c18-4ca5-acec-cb8d98a6392a tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:55.113235 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-631613d4-6c18-4ca5-acec-cb8d98a6392a tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:55.114415 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-631613d4-6c18-4ca5-acec-cb8d98a6392a tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:55.115267 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-631613d4-6c18-4ca5-acec-cb8d98a6392a tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:55.115998 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-631613d4-6c18-4ca5-acec-cb8d98a6392a tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:55.250250 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-631613d4-6c18-4ca5-acec-cb8d98a6392a tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c27f3d5edb4eb08546ccda853de534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd011dbdfa9074d418d341f1d23991844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:55.258542 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-631613d4-6c18-4ca5-acec-cb8d98a6392a tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] 10.222.0.40 "GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214" status: 200 len: 1313 microversion: 2.1 time: 0.165875 Aug 28 10:28:55.259091 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 605/1186] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:55 2022] GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:55.643889 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-65458e74-ef65-490f-8232-faab0e51e43a req-6f8c56fe-7582-4909-aa7e-62cefa25597e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a42c5d2-a943-4121-bdd8-2b982a384214", "name": "network-vif-plugged", "status": "completed", "tag": "22c87a25-4921-47f5-8135-2dbfe7207e77"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:28:55.653822 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-65458e74-ef65-490f-8232-faab0e51e43a req-6f8c56fe-7582-4909-aa7e-62cefa25597e service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:55.654224 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-65458e74-ef65-490f-8232-faab0e51e43a req-6f8c56fe-7582-4909-aa7e-62cefa25597e service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:55.654639 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-65458e74-ef65-490f-8232-faab0e51e43a req-6f8c56fe-7582-4909-aa7e-62cefa25597e service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:55.665742 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-65458e74-ef65-490f-8232-faab0e51e43a req-6f8c56fe-7582-4909-aa7e-62cefa25597e service nova] Creating event network-vif-plugged:22c87a25-4921-47f5-8135-2dbfe7207e77 for instance 0a42c5d2-a943-4121-bdd8-2b982a384214 on hv-cinder-85200 Aug 28 10:28:55.671336 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-65458e74-ef65-490f-8232-faab0e51e43a req-6f8c56fe-7582-4909-aa7e-62cefa25597e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031176 Aug 28 10:28:55.672449 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 582/1187] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:28:56.050453 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-439e2b2e-6979-4bc0-af5e-44e8749f033c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:56.051429 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-439e2b2e-6979-4bc0-af5e-44e8749f033c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:56.062035 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-439e2b2e-6979-4bc0-af5e-44e8749f033c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:56.062752 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-439e2b2e-6979-4bc0-af5e-44e8749f033c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:56.063186 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-439e2b2e-6979-4bc0-af5e-44e8749f033c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:56.063876 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-439e2b2e-6979-4bc0-af5e-44e8749f033c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:56.064350 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-439e2b2e-6979-4bc0-af5e-44e8749f033c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:56.064798 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-439e2b2e-6979-4bc0-af5e-44e8749f033c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:56.196926 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-439e2b2e-6979-4bc0-af5e-44e8749f033c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:56.205289 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-439e2b2e-6979-4bc0-af5e-44e8749f033c tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1263 microversion: 2.1 time: 0.161814 Aug 28 10:28:56.205807 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 606/1188] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:56 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:56.285707 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-075dfa4f-6139-46fd-9495-0e3291f86be0 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:56.287294 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-075dfa4f-6139-46fd-9495-0e3291f86be0 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] [instance: 0a42c5d2-a943-4121-bdd8-2b982a384214] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:56.293608 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-075dfa4f-6139-46fd-9495-0e3291f86be0 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:56.294092 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-075dfa4f-6139-46fd-9495-0e3291f86be0 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:56.294867 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-075dfa4f-6139-46fd-9495-0e3291f86be0 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:56.295559 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-075dfa4f-6139-46fd-9495-0e3291f86be0 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:56.296001 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-075dfa4f-6139-46fd-9495-0e3291f86be0 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:56.296419 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-075dfa4f-6139-46fd-9495-0e3291f86be0 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:56.434919 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-075dfa4f-6139-46fd-9495-0e3291f86be0 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c27f3d5edb4eb08546ccda853de534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd011dbdfa9074d418d341f1d23991844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:56.444490 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-075dfa4f-6139-46fd-9495-0e3291f86be0 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] 10.222.0.40 "GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214" status: 200 len: 1313 microversion: 2.1 time: 0.163538 Aug 28 10:28:56.445094 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 583/1189] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:56 2022] GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:57.230330 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b773ebe3-f03d-4cae-a4f0-b588c822f48d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:57.231320 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b773ebe3-f03d-4cae-a4f0-b588c822f48d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:57.234470 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:28:57.240534 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b773ebe3-f03d-4cae-a4f0-b588c822f48d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:57.241022 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b773ebe3-f03d-4cae-a4f0-b588c822f48d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:57.241449 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b773ebe3-f03d-4cae-a4f0-b588c822f48d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:57.242135 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b773ebe3-f03d-4cae-a4f0-b588c822f48d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:57.242581 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b773ebe3-f03d-4cae-a4f0-b588c822f48d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:57.243000 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b773ebe3-f03d-4cae-a4f0-b588c822f48d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:57.392039 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b773ebe3-f03d-4cae-a4f0-b588c822f48d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:57.400282 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b773ebe3-f03d-4cae-a4f0-b588c822f48d tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1263 microversion: 2.1 time: 0.176441 Aug 28 10:28:57.400891 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 607/1190] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:57 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1263 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:57.467462 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-6ea33ae1-d9c3-40c0-96ad-f1462222296d tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:57.468093 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-6ea33ae1-d9c3-40c0-96ad-f1462222296d tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] [instance: 0a42c5d2-a943-4121-bdd8-2b982a384214] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:57.470197 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=2 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:28:57.470847 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell0:SELECT=6 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:28:57.477538 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6ea33ae1-d9c3-40c0-96ad-f1462222296d tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:57.478015 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6ea33ae1-d9c3-40c0-96ad-f1462222296d tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:57.478441 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6ea33ae1-d9c3-40c0-96ad-f1462222296d tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:57.479123 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6ea33ae1-d9c3-40c0-96ad-f1462222296d tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:57.479563 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6ea33ae1-d9c3-40c0-96ad-f1462222296d tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:57.479977 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6ea33ae1-d9c3-40c0-96ad-f1462222296d tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:57.687510 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-b7f698d1-e8f1-48ee-bb55-2a493e5f0959 req-00013419-6cad-48f8-a660-dd00ae20589a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c1366d-54f7-4160-8e1a-96d551dd184b", "name": "network-vif-plugged", "status": "completed", "tag": "3847d05c-508c-4228-b2da-1f89bd39eed0"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:28:57.698451 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-b7f698d1-e8f1-48ee-bb55-2a493e5f0959 req-00013419-6cad-48f8-a660-dd00ae20589a service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:57.699076 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-b7f698d1-e8f1-48ee-bb55-2a493e5f0959 req-00013419-6cad-48f8-a660-dd00ae20589a service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:57.699754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-b7f698d1-e8f1-48ee-bb55-2a493e5f0959 req-00013419-6cad-48f8-a660-dd00ae20589a service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:57.714439 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-b7f698d1-e8f1-48ee-bb55-2a493e5f0959 req-00013419-6cad-48f8-a660-dd00ae20589a service nova] Creating event network-vif-plugged:3847d05c-508c-4228-b2da-1f89bd39eed0 for instance 63c1366d-54f7-4160-8e1a-96d551dd184b on hv-cinder-85200 Aug 28 10:28:57.720533 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-b7f698d1-e8f1-48ee-bb55-2a493e5f0959 req-00013419-6cad-48f8-a660-dd00ae20589a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037259 Aug 28 10:28:57.721631 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 608/1191] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:28:57.874118 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-6ea33ae1-d9c3-40c0-96ad-f1462222296d tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c27f3d5edb4eb08546ccda853de534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd011dbdfa9074d418d341f1d23991844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:57.882424 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-6ea33ae1-d9c3-40c0-96ad-f1462222296d tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] 10.222.0.40 "GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214" status: 200 len: 1313 microversion: 2.1 time: 0.418913 Aug 28 10:28:57.883000 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 584/1192] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:57 2022] GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214 => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:58.424989 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b395c4f3-386a-4ddc-a337-6a6e388a3731 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:58.425831 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b395c4f3-386a-4ddc-a337-6a6e388a3731 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:58.432441 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b395c4f3-386a-4ddc-a337-6a6e388a3731 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:58.433106 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b395c4f3-386a-4ddc-a337-6a6e388a3731 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:58.433614 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b395c4f3-386a-4ddc-a337-6a6e388a3731 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:58.434402 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b395c4f3-386a-4ddc-a337-6a6e388a3731 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:58.434957 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b395c4f3-386a-4ddc-a337-6a6e388a3731 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:58.435534 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b395c4f3-386a-4ddc-a337-6a6e388a3731 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:58.573459 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b395c4f3-386a-4ddc-a337-6a6e388a3731 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:58.581630 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b395c4f3-386a-4ddc-a337-6a6e388a3731 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1263 microversion: 2.1 time: 0.163208 Aug 28 10:28:58.582221 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 609/1193] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:58 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:58.903290 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-6a881e93-df50-4b8f-9520-be82e4ebe718 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:58.903890 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-6a881e93-df50-4b8f-9520-be82e4ebe718 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] [instance: 0a42c5d2-a943-4121-bdd8-2b982a384214] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:58.910884 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6a881e93-df50-4b8f-9520-be82e4ebe718 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:58.911361 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6a881e93-df50-4b8f-9520-be82e4ebe718 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:58.911775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6a881e93-df50-4b8f-9520-be82e4ebe718 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:58.912453 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6a881e93-df50-4b8f-9520-be82e4ebe718 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:58.912922 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6a881e93-df50-4b8f-9520-be82e4ebe718 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:58.913330 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6a881e93-df50-4b8f-9520-be82e4ebe718 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:59.049509 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-6a881e93-df50-4b8f-9520-be82e4ebe718 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c27f3d5edb4eb08546ccda853de534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd011dbdfa9074d418d341f1d23991844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:59.057691 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-6a881e93-df50-4b8f-9520-be82e4ebe718 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] 10.222.0.40 "GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214" status: 200 len: 1462 microversion: 2.1 time: 0.158329 Aug 28 10:28:59.058259 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 585/1194] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:58 2022] GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214 => generated 1462 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:59.112046 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4a80d9b1-2166-417a-8a6f-a0a11eaca9d7 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:59.112549 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4a80d9b1-2166-417a-8a6f-a0a11eaca9d7 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] [instance: 0a42c5d2-a943-4121-bdd8-2b982a384214] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:59.119121 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4a80d9b1-2166-417a-8a6f-a0a11eaca9d7 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:59.119591 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4a80d9b1-2166-417a-8a6f-a0a11eaca9d7 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:59.120013 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4a80d9b1-2166-417a-8a6f-a0a11eaca9d7 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:59.120733 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4a80d9b1-2166-417a-8a6f-a0a11eaca9d7 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:59.121174 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4a80d9b1-2166-417a-8a6f-a0a11eaca9d7 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:59.121586 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4a80d9b1-2166-417a-8a6f-a0a11eaca9d7 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:59.150681 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4a80d9b1-2166-417a-8a6f-a0a11eaca9d7 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] [instance: 0a42c5d2-a943-4121-bdd8-2b982a384214] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 28 10:28:59.237318 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4a80d9b1-2166-417a-8a6f-a0a11eaca9d7 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214" status: 204 len: 0 microversion: 2.1 time: 0.128980 Aug 28 10:28:59.237846 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 610/1195] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:28:59 2022] DELETE /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 28 10:28:59.246211 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-f977deb5-f287-4b0c-bf96-791161d981a4 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:59.246871 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-f977deb5-f287-4b0c-bf96-791161d981a4 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] [instance: 0a42c5d2-a943-4121-bdd8-2b982a384214] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:59.253339 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f977deb5-f287-4b0c-bf96-791161d981a4 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:59.253817 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f977deb5-f287-4b0c-bf96-791161d981a4 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:59.254244 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f977deb5-f287-4b0c-bf96-791161d981a4 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:59.254933 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f977deb5-f287-4b0c-bf96-791161d981a4 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:59.255378 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f977deb5-f287-4b0c-bf96-791161d981a4 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:59.255794 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-f977deb5-f287-4b0c-bf96-791161d981a4 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:59.401518 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-f977deb5-f287-4b0c-bf96-791161d981a4 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c27f3d5edb4eb08546ccda853de534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd011dbdfa9074d418d341f1d23991844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:59.411893 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-f977deb5-f287-4b0c-bf96-791161d981a4 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] 10.222.0.40 "GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214" status: 200 len: 1468 microversion: 2.1 time: 0.169600 Aug 28 10:28:59.412471 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 586/1196] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:59 2022] GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214 => generated 1468 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:28:59.602774 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-18e09448-6632-424a-8904-d25db16a0e66 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:28:59.603495 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-18e09448-6632-424a-8904-d25db16a0e66 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:28:59.610331 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-18e09448-6632-424a-8904-d25db16a0e66 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:59.610811 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-18e09448-6632-424a-8904-d25db16a0e66 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:59.611236 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-18e09448-6632-424a-8904-d25db16a0e66 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:59.611920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-18e09448-6632-424a-8904-d25db16a0e66 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:28:59.612362 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-18e09448-6632-424a-8904-d25db16a0e66 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:28:59.612861 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-18e09448-6632-424a-8904-d25db16a0e66 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:28:59.746578 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-18e09448-6632-424a-8904-d25db16a0e66 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:28:59.754809 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-18e09448-6632-424a-8904-d25db16a0e66 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1263 microversion: 2.1 time: 0.156314 Aug 28 10:28:59.755398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 611/1197] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:28:59 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:29:00.439192 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-a0bffdcf-dead-452e-b30a-dc8d2dd85297 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:29:00.439887 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-a0bffdcf-dead-452e-b30a-dc8d2dd85297 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] [instance: 0a42c5d2-a943-4121-bdd8-2b982a384214] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:29:00.454167 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a0bffdcf-dead-452e-b30a-dc8d2dd85297 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:00.454759 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a0bffdcf-dead-452e-b30a-dc8d2dd85297 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:00.455284 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a0bffdcf-dead-452e-b30a-dc8d2dd85297 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:00.456132 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a0bffdcf-dead-452e-b30a-dc8d2dd85297 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:00.456705 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a0bffdcf-dead-452e-b30a-dc8d2dd85297 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:00.457217 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a0bffdcf-dead-452e-b30a-dc8d2dd85297 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:00.595953 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-a0bffdcf-dead-452e-b30a-dc8d2dd85297 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c27f3d5edb4eb08546ccda853de534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd011dbdfa9074d418d341f1d23991844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:29:00.603977 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-a0bffdcf-dead-452e-b30a-dc8d2dd85297 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] 10.222.0.40 "GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214" status: 200 len: 1468 microversion: 2.1 time: 0.171133 Aug 28 10:29:00.604554 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 587/1198] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:29:00 2022] GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214 => generated 1468 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:29:00.779369 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6fbb92ac-2acd-4be1-b9a5-efc04c5beeb4 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:29:00.780229 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6fbb92ac-2acd-4be1-b9a5-efc04c5beeb4 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:29:00.791081 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fbb92ac-2acd-4be1-b9a5-efc04c5beeb4 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:00.791861 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fbb92ac-2acd-4be1-b9a5-efc04c5beeb4 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:00.792586 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fbb92ac-2acd-4be1-b9a5-efc04c5beeb4 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:00.793716 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fbb92ac-2acd-4be1-b9a5-efc04c5beeb4 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:00.794817 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fbb92ac-2acd-4be1-b9a5-efc04c5beeb4 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:00.795506 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fbb92ac-2acd-4be1-b9a5-efc04c5beeb4 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:00.944085 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6fbb92ac-2acd-4be1-b9a5-efc04c5beeb4 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:29:00.951885 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6fbb92ac-2acd-4be1-b9a5-efc04c5beeb4 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1263 microversion: 2.1 time: 0.179199 Aug 28 10:29:00.952431 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 612/1199] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:29:00 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1263 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:29:01.624339 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-a0f710f1-bb55-433b-a5c1-7a92f300c602 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:29:01.625008 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-a0f710f1-bb55-433b-a5c1-7a92f300c602 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] [instance: 0a42c5d2-a943-4121-bdd8-2b982a384214] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:29:01.631753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a0f710f1-bb55-433b-a5c1-7a92f300c602 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:01.632226 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a0f710f1-bb55-433b-a5c1-7a92f300c602 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:01.632683 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a0f710f1-bb55-433b-a5c1-7a92f300c602 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:01.633374 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a0f710f1-bb55-433b-a5c1-7a92f300c602 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:01.633996 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a0f710f1-bb55-433b-a5c1-7a92f300c602 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:01.634318 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a0f710f1-bb55-433b-a5c1-7a92f300c602 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:01.768788 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-a0f710f1-bb55-433b-a5c1-7a92f300c602 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c27f3d5edb4eb08546ccda853de534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd011dbdfa9074d418d341f1d23991844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:29:01.777113 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-a0f710f1-bb55-433b-a5c1-7a92f300c602 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] 10.222.0.40 "GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214" status: 200 len: 1468 microversion: 2.1 time: 0.156621 Aug 28 10:29:01.777676 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 588/1200] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:29:01 2022] GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214 => generated 1468 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:29:01.974208 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b7a1807b-0c97-4751-9849-3628f9cef7c7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:29:01.974919 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b7a1807b-0c97-4751-9849-3628f9cef7c7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:29:01.981389 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b7a1807b-0c97-4751-9849-3628f9cef7c7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:01.981867 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b7a1807b-0c97-4751-9849-3628f9cef7c7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:01.982289 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b7a1807b-0c97-4751-9849-3628f9cef7c7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:01.982976 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b7a1807b-0c97-4751-9849-3628f9cef7c7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:01.983414 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b7a1807b-0c97-4751-9849-3628f9cef7c7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:01.983826 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b7a1807b-0c97-4751-9849-3628f9cef7c7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:02.116353 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b7a1807b-0c97-4751-9849-3628f9cef7c7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:29:02.125627 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b7a1807b-0c97-4751-9849-3628f9cef7c7 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1449 microversion: 2.1 time: 0.155484 Aug 28 10:29:02.126399 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 613/1201] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:29:01 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:29:02.145964 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-647ad85b-15c4-4a58-8fec-3ab6369e056e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:29:02.146603 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-647ad85b-15c4-4a58-8fec-3ab6369e056e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:29:02.152765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-647ad85b-15c4-4a58-8fec-3ab6369e056e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:02.153239 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-647ad85b-15c4-4a58-8fec-3ab6369e056e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:02.153662 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-647ad85b-15c4-4a58-8fec-3ab6369e056e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:02.154347 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-647ad85b-15c4-4a58-8fec-3ab6369e056e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:02.154793 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-647ad85b-15c4-4a58-8fec-3ab6369e056e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:02.155329 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-647ad85b-15c4-4a58-8fec-3ab6369e056e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:02.232564 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-eebf6a4c-2062-4b9c-bad2-4697bd6379d9 req-ae44b4f3-d094-407b-90d3-791a89ab9c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a42c5d2-a943-4121-bdd8-2b982a384214", "name": "network-vif-deleted", "tag": "22c87a25-4921-47f5-8135-2dbfe7207e77"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:29:02.245205 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-eebf6a4c-2062-4b9c-bad2-4697bd6379d9 req-ae44b4f3-d094-407b-90d3-791a89ab9c6b service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:02.246406 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-eebf6a4c-2062-4b9c-bad2-4697bd6379d9 req-ae44b4f3-d094-407b-90d3-791a89ab9c6b service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:02.247076 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-eebf6a4c-2062-4b9c-bad2-4697bd6379d9 req-ae44b4f3-d094-407b-90d3-791a89ab9c6b service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:02.262666 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-eebf6a4c-2062-4b9c-bad2-4697bd6379d9 req-ae44b4f3-d094-407b-90d3-791a89ab9c6b service nova] Creating event network-vif-deleted:22c87a25-4921-47f5-8135-2dbfe7207e77 for instance 0a42c5d2-a943-4121-bdd8-2b982a384214 on hv-cinder-85200 Aug 28 10:29:02.268330 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-eebf6a4c-2062-4b9c-bad2-4697bd6379d9 req-ae44b4f3-d094-407b-90d3-791a89ab9c6b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039412 Aug 28 10:29:02.269233 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 614/1202] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:29:02.328991 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-647ad85b-15c4-4a58-8fec-3ab6369e056e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:29:02.337312 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-647ad85b-15c4-4a58-8fec-3ab6369e056e tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1449 microversion: 2.1 time: 0.195541 Aug 28 10:29:02.337996 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 589/1203] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:29:02 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1449 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:29:02.799142 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f7f2bf88-2da9-4f20-94ab-c3e5c076b9ce tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:29:02.800231 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f7f2bf88-2da9-4f20-94ab-c3e5c076b9ce tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] [instance: 0a42c5d2-a943-4121-bdd8-2b982a384214] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:29:02.806254 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f7f2bf88-2da9-4f20-94ab-c3e5c076b9ce tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:02.806826 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f7f2bf88-2da9-4f20-94ab-c3e5c076b9ce tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:02.807313 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f7f2bf88-2da9-4f20-94ab-c3e5c076b9ce tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:02.807993 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f7f2bf88-2da9-4f20-94ab-c3e5c076b9ce tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:02.808438 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f7f2bf88-2da9-4f20-94ab-c3e5c076b9ce tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:02.808876 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f7f2bf88-2da9-4f20-94ab-c3e5c076b9ce tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:02.840741 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f7f2bf88-2da9-4f20-94ab-c3e5c076b9ce tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:02.841220 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f7f2bf88-2da9-4f20-94ab-c3e5c076b9ce tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:02.841637 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f7f2bf88-2da9-4f20-94ab-c3e5c076b9ce tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:02.842075 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-f7f2bf88-2da9-4f20-94ab-c3e5c076b9ce tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lazy-loading 'fault' on Instance uuid 0a42c5d2-a943-4121-bdd8-2b982a384214 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:29:02.895409 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f7f2bf88-2da9-4f20-94ab-c3e5c076b9ce tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c27f3d5edb4eb08546ccda853de534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd011dbdfa9074d418d341f1d23991844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:29:02.904336 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f7f2bf88-2da9-4f20-94ab-c3e5c076b9ce tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] 10.222.0.40 "GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214" status: 200 len: 1303 microversion: 2.1 time: 0.109884 Aug 28 10:29:02.904959 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 615/1204] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:29:02 2022] GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214 => generated 1303 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:29:03.928069 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-a386e9b6-5977-40f7-a3da-3c9e7370cf91 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:29:03.930310 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-a386e9b6-5977-40f7-a3da-3c9e7370cf91 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] [instance: 0a42c5d2-a943-4121-bdd8-2b982a384214] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:29:03.938814 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a386e9b6-5977-40f7-a3da-3c9e7370cf91 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:03.939610 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a386e9b6-5977-40f7-a3da-3c9e7370cf91 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:03.940100 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a386e9b6-5977-40f7-a3da-3c9e7370cf91 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:03.940896 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a386e9b6-5977-40f7-a3da-3c9e7370cf91 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:03.941401 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a386e9b6-5977-40f7-a3da-3c9e7370cf91 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:03.941895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-a386e9b6-5977-40f7-a3da-3c9e7370cf91 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:03.956405 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-a386e9b6-5977-40f7-a3da-3c9e7370cf91 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] HTTP exception thrown: Instance 0a42c5d2-a943-4121-bdd8-2b982a384214 could not be found. Aug 28 10:29:03.958215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-a386e9b6-5977-40f7-a3da-3c9e7370cf91 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Request method failure captured: Aug 28 10:29:03.958215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214 HTTP/1.1 Aug 28 10:29:03.958215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:29:03.958215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:29:03.958215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:29:03.958215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:29:03.958215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:29:03.958215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:29:03.958215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:29:03.958215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:29:03.958215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0NcBj1QWHMVklnOoVFkywHAjvheLMACwxESWwEDm2x5yYnGXDgOP3R_4gGfx4E1drjx9vC-wyGpNSJ-O_syScZqs0C8E6eIAYX0hZuMEeRgiX62d3_AgrmYzIw3JO4LzvR4N094Vjo7FGaivefVaRwhp-5u4GBPjGlzSQrpezYyqzE Aug 28 10:29:03.958215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:29:03.958215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:29:03.958215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:29:03.958215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:29:03.958215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:29:03.958215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:29:03.958215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: d011dbdfa9074d418d341f1d23991844 Aug 28 10:29:03.958215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-VolumesNegativeTest-673872491 Aug 28 10:29:03.958215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:29:03.958215 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:29:03.959857 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d011dbdfa9074d418d341f1d23991844", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d011dbdfa9074d418d341f1d23991844"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d011dbdfa9074d418d341f1d23991844"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d011dbdfa9074d418d341f1d23991844"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:29:03.959857 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-VolumesNegativeTest-673872491 Aug 28 10:29:03.959857 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: d011dbdfa9074d418d341f1d23991844 Aug 28 10:29:03.959857 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-VolumesNegativeTest-673872491 Aug 28 10:29:03.959857 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-VolumesNegativeTest-673872491-project Aug 28 10:29:03.959857 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:29:03.959857 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:29:03.959857 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: c3c27f3d5edb4eb08546ccda853de534 Aug 28 10:29:03.959857 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-VolumesNegativeTest-673872491-project Aug 28 10:29:03.959857 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: > Aug 28 10:29:03.959857 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Instance 0a42c5d2-a943-4121-bdd8-2b982a384214 could not be found. Aug 28 10:29:03.959857 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': '0a42c5d2-a943-4121-bdd8-2b982a384214'} Aug 28 10:29:03.960801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:29:03.960801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:29:03.960801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:29:03.960801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:29:03.960801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:29:03.960801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:29:03.960801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:29:03.960801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:29:03.960801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:29:03.960801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:29:03.960801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a42c5d2-a943-4121-bdd8-2b982a384214 could not be found. Aug 28 10:29:03.960801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:29:03.960801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:29:03.960801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:29:03.960801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:29:03.960801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:29:03.960801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:29:03.960801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:29:03.960801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:29:03.960801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:29:03.962337 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:29:03.962337 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:29:03.962337 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:29:03.962337 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:29:03.962337 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:29:03.962337 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:29:03.962337 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:29:03.962337 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a42c5d2-a943-4121-bdd8-2b982a384214 could not be found. Aug 28 10:29:03.962337 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:29:03.962337 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:29:03.962337 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:29:03.962337 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:29:03.962337 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:29:03.962337 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:29:03.962337 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:29:03.962337 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:29:03.962337 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a42c5d2-a943-4121-bdd8-2b982a384214 could not be found. Aug 28 10:29:03.962337 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:29:03.963637 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-a386e9b6-5977-40f7-a3da-3c9e7370cf91 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] Returning 404 to user: Instance 0a42c5d2-a943-4121-bdd8-2b982a384214 could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:29:03.963637 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-a386e9b6-5977-40f7-a3da-3c9e7370cf91 tempest-VolumesNegativeTest-673872491 tempest-VolumesNegativeTest-673872491-project] 10.222.0.40 "GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214" status: 404 len: 111 microversion: 2.1 time: 0.036589 Aug 28 10:29:03.966062 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 590/1205] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:29:03 2022] GET /compute/v2.1/servers/0a42c5d2-a943-4121-bdd8-2b982a384214 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:29:04.128678 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-e956f6b3-49c6-4ec0-a18d-43f7723b6cbd req-3c942d17-dc97-4b2c-8e9c-677998dd94bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63c1366d-54f7-4160-8e1a-96d551dd184b", "tag": "3847d05c-508c-4228-b2da-1f89bd39eed0"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:29:04.142423 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-e956f6b3-49c6-4ec0-a18d-43f7723b6cbd req-3c942d17-dc97-4b2c-8e9c-677998dd94bd service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:04.143477 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-e956f6b3-49c6-4ec0-a18d-43f7723b6cbd req-3c942d17-dc97-4b2c-8e9c-677998dd94bd service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:04.144078 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-e956f6b3-49c6-4ec0-a18d-43f7723b6cbd req-3c942d17-dc97-4b2c-8e9c-677998dd94bd service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:04.159531 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-e956f6b3-49c6-4ec0-a18d-43f7723b6cbd req-3c942d17-dc97-4b2c-8e9c-677998dd94bd service nova] Creating event network-changed:3847d05c-508c-4228-b2da-1f89bd39eed0 for instance 63c1366d-54f7-4160-8e1a-96d551dd184b on hv-cinder-85200 Aug 28 10:29:04.166348 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-e956f6b3-49c6-4ec0-a18d-43f7723b6cbd req-3c942d17-dc97-4b2c-8e9c-677998dd94bd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042922 Aug 28 10:29:04.168938 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 616/1206] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:29:47.144208 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-46752913-1734-4728-a0f2-2ebf096b1964 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:29:47.147765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-46752913-1734-4728-a0f2-2ebf096b1964 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:29:47.150993 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=23 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:29:47.151618 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=81 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:29:47.152722 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 28 10:29:47.152907 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Sun Aug 28 10:29:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2/action (ip 10.222.0.40) !!! Aug 28 10:29:47.161432 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46752913-1734-4728-a0f2-2ebf096b1964 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:47.161907 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46752913-1734-4728-a0f2-2ebf096b1964 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:47.162335 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46752913-1734-4728-a0f2-2ebf096b1964 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:47.163030 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46752913-1734-4728-a0f2-2ebf096b1964 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:47.163472 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46752913-1734-4728-a0f2-2ebf096b1964 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:47.163893 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-46752913-1734-4728-a0f2-2ebf096b1964 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:47.242901 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-46752913-1734-4728-a0f2-2ebf096b1964 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "POST /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2/action" status: 202 len: 0 microversion: 2.1 time: 0.105498 Aug 28 10:29:47.244331 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 591/1207] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Aug 28 10:29:47 2022] POST /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:29:47.250895 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:29:47.252230 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:29:47.257164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-621a6743-5829-4d99-a1bb-b86f426fef5d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:29:47.257885 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-621a6743-5829-4d99-a1bb-b86f426fef5d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:29:47.267630 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-621a6743-5829-4d99-a1bb-b86f426fef5d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:47.268173 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-621a6743-5829-4d99-a1bb-b86f426fef5d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:47.268865 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-621a6743-5829-4d99-a1bb-b86f426fef5d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:47.269911 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-621a6743-5829-4d99-a1bb-b86f426fef5d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:47.270380 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-621a6743-5829-4d99-a1bb-b86f426fef5d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:47.270961 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-621a6743-5829-4d99-a1bb-b86f426fef5d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:47.502896 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-621a6743-5829-4d99-a1bb-b86f426fef5d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:29:47.511467 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-621a6743-5829-4d99-a1bb-b86f426fef5d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1752 microversion: 2.1 time: 0.262455 Aug 28 10:29:47.512052 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 617/1208] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:29:47 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1752 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:29:48.535939 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-038f2958-131e-4502-bd87-dd3110e5c9ab tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:29:48.536689 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-038f2958-131e-4502-bd87-dd3110e5c9ab tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:29:48.547355 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-038f2958-131e-4502-bd87-dd3110e5c9ab tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:48.548033 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-038f2958-131e-4502-bd87-dd3110e5c9ab tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:48.548699 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-038f2958-131e-4502-bd87-dd3110e5c9ab tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:48.549736 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-038f2958-131e-4502-bd87-dd3110e5c9ab tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:48.550397 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-038f2958-131e-4502-bd87-dd3110e5c9ab tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:48.550984 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-038f2958-131e-4502-bd87-dd3110e5c9ab tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:48.705492 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-038f2958-131e-4502-bd87-dd3110e5c9ab tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:29:48.714318 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-038f2958-131e-4502-bd87-dd3110e5c9ab tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1757 microversion: 2.1 time: 0.184135 Aug 28 10:29:48.714935 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 592/1209] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:29:48 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:29:49.737635 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f45a5028-f2bc-48e0-b9a2-04eb0b14a8c3 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:29:49.738550 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f45a5028-f2bc-48e0-b9a2-04eb0b14a8c3 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:29:49.748895 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f45a5028-f2bc-48e0-b9a2-04eb0b14a8c3 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:49.749600 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f45a5028-f2bc-48e0-b9a2-04eb0b14a8c3 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:49.750239 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f45a5028-f2bc-48e0-b9a2-04eb0b14a8c3 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:49.751274 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f45a5028-f2bc-48e0-b9a2-04eb0b14a8c3 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:49.751949 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f45a5028-f2bc-48e0-b9a2-04eb0b14a8c3 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:49.752579 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f45a5028-f2bc-48e0-b9a2-04eb0b14a8c3 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:49.911411 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f45a5028-f2bc-48e0-b9a2-04eb0b14a8c3 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:29:49.920707 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f45a5028-f2bc-48e0-b9a2-04eb0b14a8c3 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1757 microversion: 2.1 time: 0.188783 Aug 28 10:29:49.921288 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 618/1210] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:29:49 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:29:50.947074 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-26309119-3296-4d95-bd57-f3db4921a1a1 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:29:50.948034 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-26309119-3296-4d95-bd57-f3db4921a1a1 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:29:50.959141 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-26309119-3296-4d95-bd57-f3db4921a1a1 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:50.959935 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-26309119-3296-4d95-bd57-f3db4921a1a1 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:50.960742 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-26309119-3296-4d95-bd57-f3db4921a1a1 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:50.961840 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-26309119-3296-4d95-bd57-f3db4921a1a1 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:50.962583 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-26309119-3296-4d95-bd57-f3db4921a1a1 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:50.963288 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-26309119-3296-4d95-bd57-f3db4921a1a1 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:51.127407 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-26309119-3296-4d95-bd57-f3db4921a1a1 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:29:51.139739 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-26309119-3296-4d95-bd57-f3db4921a1a1 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1757 microversion: 2.1 time: 0.199265 Aug 28 10:29:51.140309 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 593/1211] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:29:50 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1757 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:29:52.165034 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-30b6b210-e9cb-4ec0-afde-6bb529471597 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:29:52.166038 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-30b6b210-e9cb-4ec0-afde-6bb529471597 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:29:52.177337 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30b6b210-e9cb-4ec0-afde-6bb529471597 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:52.178102 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30b6b210-e9cb-4ec0-afde-6bb529471597 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:52.178804 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30b6b210-e9cb-4ec0-afde-6bb529471597 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:52.179934 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30b6b210-e9cb-4ec0-afde-6bb529471597 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:52.180714 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30b6b210-e9cb-4ec0-afde-6bb529471597 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:52.181414 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30b6b210-e9cb-4ec0-afde-6bb529471597 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:52.339950 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-30b6b210-e9cb-4ec0-afde-6bb529471597 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:29:52.349124 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-30b6b210-e9cb-4ec0-afde-6bb529471597 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1757 microversion: 2.1 time: 0.190655 Aug 28 10:29:52.349700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 619/1212] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:29:52 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:29:53.369832 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-1bcf4c4f-57c6-4f10-adf9-d4681d273892 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:29:53.370451 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-1bcf4c4f-57c6-4f10-adf9-d4681d273892 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:29:53.377009 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1bcf4c4f-57c6-4f10-adf9-d4681d273892 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:53.377478 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1bcf4c4f-57c6-4f10-adf9-d4681d273892 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:53.377894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1bcf4c4f-57c6-4f10-adf9-d4681d273892 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:53.378564 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1bcf4c4f-57c6-4f10-adf9-d4681d273892 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:53.378999 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1bcf4c4f-57c6-4f10-adf9-d4681d273892 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:53.379408 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1bcf4c4f-57c6-4f10-adf9-d4681d273892 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:53.525120 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-1bcf4c4f-57c6-4f10-adf9-d4681d273892 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:29:53.534011 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-1bcf4c4f-57c6-4f10-adf9-d4681d273892 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1757 microversion: 2.1 time: 0.168056 Aug 28 10:29:53.534556 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 594/1213] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:29:53 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:29:54.562968 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-095f3e57-afbd-47d7-ab94-d24b0b672d3c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:29:54.563928 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-095f3e57-afbd-47d7-ab94-d24b0b672d3c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:29:54.574609 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-095f3e57-afbd-47d7-ab94-d24b0b672d3c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:54.575398 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-095f3e57-afbd-47d7-ab94-d24b0b672d3c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:54.576087 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-095f3e57-afbd-47d7-ab94-d24b0b672d3c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:54.577288 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-095f3e57-afbd-47d7-ab94-d24b0b672d3c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:54.578042 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-095f3e57-afbd-47d7-ab94-d24b0b672d3c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:54.578792 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-095f3e57-afbd-47d7-ab94-d24b0b672d3c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:54.734330 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-095f3e57-afbd-47d7-ab94-d24b0b672d3c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:29:54.746634 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-095f3e57-afbd-47d7-ab94-d24b0b672d3c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1757 microversion: 2.1 time: 0.190260 Aug 28 10:29:54.747325 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 620/1214] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:29:54 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:29:55.772108 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-87a2c559-e8a7-4f21-8154-eed4277fe0b1 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:29:55.773165 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-87a2c559-e8a7-4f21-8154-eed4277fe0b1 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:29:55.784030 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-87a2c559-e8a7-4f21-8154-eed4277fe0b1 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:55.784899 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-87a2c559-e8a7-4f21-8154-eed4277fe0b1 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:55.785615 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-87a2c559-e8a7-4f21-8154-eed4277fe0b1 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:55.786749 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-87a2c559-e8a7-4f21-8154-eed4277fe0b1 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:55.787492 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-87a2c559-e8a7-4f21-8154-eed4277fe0b1 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:55.788191 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-87a2c559-e8a7-4f21-8154-eed4277fe0b1 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:55.941135 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-87a2c559-e8a7-4f21-8154-eed4277fe0b1 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:29:55.953932 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-87a2c559-e8a7-4f21-8154-eed4277fe0b1 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1757 microversion: 2.1 time: 0.188023 Aug 28 10:29:55.954676 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 595/1215] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:29:55 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:29:56.983766 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cdc3680d-4209-4e03-a071-52c1f0db91f2 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:29:56.984489 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cdc3680d-4209-4e03-a071-52c1f0db91f2 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:29:56.993103 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cdc3680d-4209-4e03-a071-52c1f0db91f2 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:56.993690 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cdc3680d-4209-4e03-a071-52c1f0db91f2 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:56.994211 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cdc3680d-4209-4e03-a071-52c1f0db91f2 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:56.995052 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cdc3680d-4209-4e03-a071-52c1f0db91f2 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:56.995599 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cdc3680d-4209-4e03-a071-52c1f0db91f2 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:56.996107 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cdc3680d-4209-4e03-a071-52c1f0db91f2 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:57.142154 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cdc3680d-4209-4e03-a071-52c1f0db91f2 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:29:57.150971 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cdc3680d-4209-4e03-a071-52c1f0db91f2 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1757 microversion: 2.1 time: 0.173712 Aug 28 10:29:57.151537 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 621/1216] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:29:56 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:29:58.174210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c58b4f20-e7f6-4678-affd-3224c0392f71 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:29:58.174823 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c58b4f20-e7f6-4678-affd-3224c0392f71 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:29:58.181692 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c58b4f20-e7f6-4678-affd-3224c0392f71 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:58.182173 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c58b4f20-e7f6-4678-affd-3224c0392f71 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:58.182600 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c58b4f20-e7f6-4678-affd-3224c0392f71 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:58.183281 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c58b4f20-e7f6-4678-affd-3224c0392f71 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:58.183719 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c58b4f20-e7f6-4678-affd-3224c0392f71 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:58.184134 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c58b4f20-e7f6-4678-affd-3224c0392f71 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:58.326887 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c58b4f20-e7f6-4678-affd-3224c0392f71 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:29:58.335396 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c58b4f20-e7f6-4678-affd-3224c0392f71 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1757 microversion: 2.1 time: 0.165291 Aug 28 10:29:58.335974 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 596/1217] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:29:58 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:29:59.356731 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-179f4aee-9897-4aec-a833-d5a08c91caf4 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:29:59.357348 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-179f4aee-9897-4aec-a833-d5a08c91caf4 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:29:59.363917 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-179f4aee-9897-4aec-a833-d5a08c91caf4 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:59.364394 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-179f4aee-9897-4aec-a833-d5a08c91caf4 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:59.364851 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-179f4aee-9897-4aec-a833-d5a08c91caf4 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:59.365529 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-179f4aee-9897-4aec-a833-d5a08c91caf4 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:29:59.365979 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-179f4aee-9897-4aec-a833-d5a08c91caf4 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:29:59.366390 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-179f4aee-9897-4aec-a833-d5a08c91caf4 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:29:59.516790 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-179f4aee-9897-4aec-a833-d5a08c91caf4 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:29:59.525143 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-179f4aee-9897-4aec-a833-d5a08c91caf4 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1760 microversion: 2.1 time: 0.172333 Aug 28 10:29:59.525699 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 622/1218] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:29:59 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1760 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:03.768159 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c38e57b1-6a91-4f76-8b9c-afe572fa7007 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:30:03.769121 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c38e57b1-6a91-4f76-8b9c-afe572fa7007 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:03.779522 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c38e57b1-6a91-4f76-8b9c-afe572fa7007 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:03.780196 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c38e57b1-6a91-4f76-8b9c-afe572fa7007 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:03.780635 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c38e57b1-6a91-4f76-8b9c-afe572fa7007 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:03.781344 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c38e57b1-6a91-4f76-8b9c-afe572fa7007 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:03.781787 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c38e57b1-6a91-4f76-8b9c-afe572fa7007 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:03.782210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c38e57b1-6a91-4f76-8b9c-afe572fa7007 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:03.805489 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.objects.instance [None req-c38e57b1-6a91-4f76-8b9c-afe572fa7007 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lazy-loading 'flavor' on Instance uuid 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae {{(pid=120664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:30:03.886936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c38e57b1-6a91-4f76-8b9c-afe572fa7007 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "POST /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae/action" status: 202 len: 0 microversion: 2.1 time: 0.125535 Aug 28 10:30:03.887521 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 597/1219] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Aug 28 10:30:03 2022] POST /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:30:03.896967 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6be2f066-2cf2-4de8-b6e2-3abaf0d621a2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:03.897539 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6be2f066-2cf2-4de8-b6e2-3abaf0d621a2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:03.904652 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6be2f066-2cf2-4de8-b6e2-3abaf0d621a2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:03.905298 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6be2f066-2cf2-4de8-b6e2-3abaf0d621a2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:03.905802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6be2f066-2cf2-4de8-b6e2-3abaf0d621a2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:03.906626 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6be2f066-2cf2-4de8-b6e2-3abaf0d621a2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:03.907230 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6be2f066-2cf2-4de8-b6e2-3abaf0d621a2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:03.907652 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6be2f066-2cf2-4de8-b6e2-3abaf0d621a2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:04.057377 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6be2f066-2cf2-4de8-b6e2-3abaf0d621a2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:04.066777 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6be2f066-2cf2-4de8-b6e2-3abaf0d621a2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1566 microversion: 2.1 time: 0.174700 Aug 28 10:30:04.067366 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 623/1220] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:03 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:05.095701 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-d744a96e-4ebd-470b-9529-3d819774deb7 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:05.096930 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-d744a96e-4ebd-470b-9529-3d819774deb7 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:05.107406 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d744a96e-4ebd-470b-9529-3d819774deb7 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:05.108136 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d744a96e-4ebd-470b-9529-3d819774deb7 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:05.108624 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d744a96e-4ebd-470b-9529-3d819774deb7 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:05.109860 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d744a96e-4ebd-470b-9529-3d819774deb7 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:05.109860 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d744a96e-4ebd-470b-9529-3d819774deb7 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:05.110127 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d744a96e-4ebd-470b-9529-3d819774deb7 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:05.246892 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d744a96e-4ebd-470b-9529-3d819774deb7 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:05.255308 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-d744a96e-4ebd-470b-9529-3d819774deb7 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1566 microversion: 2.1 time: 0.169268 Aug 28 10:30:05.255882 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 598/1221] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:05 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:06.280462 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b7271fb7-3fd2-4676-b482-dd14c8072599 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:06.281221 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b7271fb7-3fd2-4676-b482-dd14c8072599 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:06.287696 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b7271fb7-3fd2-4676-b482-dd14c8072599 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:06.288173 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b7271fb7-3fd2-4676-b482-dd14c8072599 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:06.288635 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b7271fb7-3fd2-4676-b482-dd14c8072599 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:06.289324 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b7271fb7-3fd2-4676-b482-dd14c8072599 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:06.289767 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b7271fb7-3fd2-4676-b482-dd14c8072599 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:06.290185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b7271fb7-3fd2-4676-b482-dd14c8072599 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:06.430280 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b7271fb7-3fd2-4676-b482-dd14c8072599 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:06.442778 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b7271fb7-3fd2-4676-b482-dd14c8072599 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1566 microversion: 2.1 time: 0.168250 Aug 28 10:30:06.443734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 624/1222] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:06 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:07.467613 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-cfc6ea39-440c-4b1c-8154-84b281151a20 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:07.468196 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-cfc6ea39-440c-4b1c-8154-84b281151a20 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:07.475204 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cfc6ea39-440c-4b1c-8154-84b281151a20 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:07.475688 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cfc6ea39-440c-4b1c-8154-84b281151a20 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:07.476120 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cfc6ea39-440c-4b1c-8154-84b281151a20 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:07.476891 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cfc6ea39-440c-4b1c-8154-84b281151a20 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:07.477338 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cfc6ea39-440c-4b1c-8154-84b281151a20 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:07.477759 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-cfc6ea39-440c-4b1c-8154-84b281151a20 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:07.618197 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-cfc6ea39-440c-4b1c-8154-84b281151a20 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:07.626238 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-cfc6ea39-440c-4b1c-8154-84b281151a20 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1566 microversion: 2.1 time: 0.162683 Aug 28 10:30:07.626823 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 599/1223] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:07 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:08.651950 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4f2988d5-8aa7-4b6c-9e07-ba3b23ff49c5 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:08.652974 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4f2988d5-8aa7-4b6c-9e07-ba3b23ff49c5 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:08.663902 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f2988d5-8aa7-4b6c-9e07-ba3b23ff49c5 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:08.664734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f2988d5-8aa7-4b6c-9e07-ba3b23ff49c5 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:08.665433 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f2988d5-8aa7-4b6c-9e07-ba3b23ff49c5 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:08.666558 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f2988d5-8aa7-4b6c-9e07-ba3b23ff49c5 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:08.667291 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f2988d5-8aa7-4b6c-9e07-ba3b23ff49c5 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:08.667975 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f2988d5-8aa7-4b6c-9e07-ba3b23ff49c5 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:08.809288 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4f2988d5-8aa7-4b6c-9e07-ba3b23ff49c5 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:08.817821 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4f2988d5-8aa7-4b6c-9e07-ba3b23ff49c5 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1566 microversion: 2.1 time: 0.172434 Aug 28 10:30:08.818439 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 625/1224] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:08 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:09.840496 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-d0fd88fc-a157-486f-9095-949524076abb tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:09.841120 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-d0fd88fc-a157-486f-9095-949524076abb tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:09.848449 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d0fd88fc-a157-486f-9095-949524076abb tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:09.848889 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d0fd88fc-a157-486f-9095-949524076abb tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:09.849311 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d0fd88fc-a157-486f-9095-949524076abb tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:09.850003 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d0fd88fc-a157-486f-9095-949524076abb tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:09.850444 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d0fd88fc-a157-486f-9095-949524076abb tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:09.850855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d0fd88fc-a157-486f-9095-949524076abb tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:09.989283 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-d0fd88fc-a157-486f-9095-949524076abb tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:09.997041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-d0fd88fc-a157-486f-9095-949524076abb tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1566 microversion: 2.1 time: 0.161837 Aug 28 10:30:09.997608 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 600/1225] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:09 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:11.023106 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dd7db064-9177-408d-aea4-530b780c533d tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:11.024156 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-dd7db064-9177-408d-aea4-530b780c533d tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:11.035199 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dd7db064-9177-408d-aea4-530b780c533d tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:11.035989 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dd7db064-9177-408d-aea4-530b780c533d tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:11.036747 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dd7db064-9177-408d-aea4-530b780c533d tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:11.037891 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dd7db064-9177-408d-aea4-530b780c533d tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:11.038630 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dd7db064-9177-408d-aea4-530b780c533d tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:11.039324 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dd7db064-9177-408d-aea4-530b780c533d tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:11.178602 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dd7db064-9177-408d-aea4-530b780c533d tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:11.186666 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-dd7db064-9177-408d-aea4-530b780c533d tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1566 microversion: 2.1 time: 0.170151 Aug 28 10:30:11.187258 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 626/1226] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:11 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:12.207559 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8cff24ab-35ac-4eea-af36-8307516658af tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:12.208188 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-8cff24ab-35ac-4eea-af36-8307516658af tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:12.215400 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8cff24ab-35ac-4eea-af36-8307516658af tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:12.215904 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8cff24ab-35ac-4eea-af36-8307516658af tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:12.216328 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8cff24ab-35ac-4eea-af36-8307516658af tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:12.217136 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8cff24ab-35ac-4eea-af36-8307516658af tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:12.217582 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8cff24ab-35ac-4eea-af36-8307516658af tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:12.217992 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8cff24ab-35ac-4eea-af36-8307516658af tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:12.352163 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8cff24ab-35ac-4eea-af36-8307516658af tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:12.360101 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-8cff24ab-35ac-4eea-af36-8307516658af tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1566 microversion: 2.1 time: 0.156505 Aug 28 10:30:12.360701 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 601/1227] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:12 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:13.381204 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3c0e7b58-8960-4866-9ab4-6bbbd93f9f42 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:13.381921 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3c0e7b58-8960-4866-9ab4-6bbbd93f9f42 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:13.388358 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3c0e7b58-8960-4866-9ab4-6bbbd93f9f42 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:13.388910 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3c0e7b58-8960-4866-9ab4-6bbbd93f9f42 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:13.389342 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3c0e7b58-8960-4866-9ab4-6bbbd93f9f42 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:13.390038 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3c0e7b58-8960-4866-9ab4-6bbbd93f9f42 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:13.390486 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3c0e7b58-8960-4866-9ab4-6bbbd93f9f42 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:13.391254 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3c0e7b58-8960-4866-9ab4-6bbbd93f9f42 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:13.526506 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3c0e7b58-8960-4866-9ab4-6bbbd93f9f42 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:13.534425 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3c0e7b58-8960-4866-9ab4-6bbbd93f9f42 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1566 microversion: 2.1 time: 0.157168 Aug 28 10:30:13.535183 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 627/1228] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:13 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:14.556211 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e4a713ac-cd89-4ed3-bba5-55b2760e6281 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:14.556879 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e4a713ac-cd89-4ed3-bba5-55b2760e6281 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:14.564018 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e4a713ac-cd89-4ed3-bba5-55b2760e6281 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:14.564493 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e4a713ac-cd89-4ed3-bba5-55b2760e6281 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:14.564944 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e4a713ac-cd89-4ed3-bba5-55b2760e6281 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:14.565655 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e4a713ac-cd89-4ed3-bba5-55b2760e6281 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:14.566097 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e4a713ac-cd89-4ed3-bba5-55b2760e6281 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:14.566506 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e4a713ac-cd89-4ed3-bba5-55b2760e6281 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:15.012962 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-e4a713ac-cd89-4ed3-bba5-55b2760e6281 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:15.021745 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-e4a713ac-cd89-4ed3-bba5-55b2760e6281 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1566 microversion: 2.1 time: 0.469569 Aug 28 10:30:15.022339 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 602/1229] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:14 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1566 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:16.047831 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b22b9e50-5de5-4c89-9e38-a4eb0243666d tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:16.048836 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b22b9e50-5de5-4c89-9e38-a4eb0243666d tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:16.059798 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b22b9e50-5de5-4c89-9e38-a4eb0243666d tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:16.060598 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b22b9e50-5de5-4c89-9e38-a4eb0243666d tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:16.061242 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b22b9e50-5de5-4c89-9e38-a4eb0243666d tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:16.061908 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b22b9e50-5de5-4c89-9e38-a4eb0243666d tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:16.062392 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b22b9e50-5de5-4c89-9e38-a4eb0243666d tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:16.062812 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b22b9e50-5de5-4c89-9e38-a4eb0243666d tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:16.210232 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b22b9e50-5de5-4c89-9e38-a4eb0243666d tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:16.221131 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b22b9e50-5de5-4c89-9e38-a4eb0243666d tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1566 microversion: 2.1 time: 0.179874 Aug 28 10:30:16.221916 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 628/1230] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:16 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:17.246377 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-6afc3bf5-f107-41fa-a40b-0a223b8a5468 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:17.246957 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-6afc3bf5-f107-41fa-a40b-0a223b8a5468 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:17.249445 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=25 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:30:17.254613 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6afc3bf5-f107-41fa-a40b-0a223b8a5468 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:17.255080 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6afc3bf5-f107-41fa-a40b-0a223b8a5468 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:17.255608 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6afc3bf5-f107-41fa-a40b-0a223b8a5468 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:17.256285 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6afc3bf5-f107-41fa-a40b-0a223b8a5468 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:17.256762 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6afc3bf5-f107-41fa-a40b-0a223b8a5468 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:17.257159 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-6afc3bf5-f107-41fa-a40b-0a223b8a5468 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:17.260097 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:30:17.387730 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-6afc3bf5-f107-41fa-a40b-0a223b8a5468 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:17.396861 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-6afc3bf5-f107-41fa-a40b-0a223b8a5468 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1566 microversion: 2.1 time: 0.154493 Aug 28 10:30:17.397441 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 603/1231] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:17 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:18.418155 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1e5a35bd-b4e9-4b13-b4f2-a001d450cf5c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:18.418728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1e5a35bd-b4e9-4b13-b4f2-a001d450cf5c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:18.421523 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=25 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:30:18.427073 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e5a35bd-b4e9-4b13-b4f2-a001d450cf5c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:18.427543 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e5a35bd-b4e9-4b13-b4f2-a001d450cf5c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:18.427960 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e5a35bd-b4e9-4b13-b4f2-a001d450cf5c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:18.428667 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e5a35bd-b4e9-4b13-b4f2-a001d450cf5c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:18.429103 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e5a35bd-b4e9-4b13-b4f2-a001d450cf5c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:18.429511 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e5a35bd-b4e9-4b13-b4f2-a001d450cf5c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:18.432025 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=73 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:30:18.562604 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1e5a35bd-b4e9-4b13-b4f2-a001d450cf5c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:18.570518 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1e5a35bd-b4e9-4b13-b4f2-a001d450cf5c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1507 microversion: 2.1 time: 0.156320 Aug 28 10:30:18.571074 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 629/1232] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:18 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:18.595293 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-3e614b49-6495-4522-aff3-14d5f88351e2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:30:18.596494 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-3e614b49-6495-4522-aff3-14d5f88351e2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:18.603775 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3e614b49-6495-4522-aff3-14d5f88351e2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:18.604250 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3e614b49-6495-4522-aff3-14d5f88351e2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:18.604715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3e614b49-6495-4522-aff3-14d5f88351e2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:18.605374 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3e614b49-6495-4522-aff3-14d5f88351e2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:18.605845 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3e614b49-6495-4522-aff3-14d5f88351e2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:18.606250 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-3e614b49-6495-4522-aff3-14d5f88351e2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:18.635783 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-3e614b49-6495-4522-aff3-14d5f88351e2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120664) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 28 10:30:18.707261 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-3e614b49-6495-4522-aff3-14d5f88351e2 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "POST /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae/action" status: 202 len: 0 microversion: 2.1 time: 0.115720 Aug 28 10:30:18.708115 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 604/1233] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Aug 28 10:30:18 2022] POST /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:30:18.716073 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4d94e41a-0a07-4f11-9b3e-420a92975975 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:18.716706 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4d94e41a-0a07-4f11-9b3e-420a92975975 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:18.722657 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d94e41a-0a07-4f11-9b3e-420a92975975 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:18.723124 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d94e41a-0a07-4f11-9b3e-420a92975975 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:18.723542 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d94e41a-0a07-4f11-9b3e-420a92975975 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:18.724223 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d94e41a-0a07-4f11-9b3e-420a92975975 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:18.724685 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d94e41a-0a07-4f11-9b3e-420a92975975 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:18.725092 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d94e41a-0a07-4f11-9b3e-420a92975975 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:18.887919 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4d94e41a-0a07-4f11-9b3e-420a92975975 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:18.896114 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4d94e41a-0a07-4f11-9b3e-420a92975975 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1515 microversion: 2.1 time: 0.183913 Aug 28 10:30:18.896996 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 630/1234] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:18 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:19.918000 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4614b7e2-3ee2-4192-955f-702b965e2cc0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:19.918626 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4614b7e2-3ee2-4192-955f-702b965e2cc0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:19.925473 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4614b7e2-3ee2-4192-955f-702b965e2cc0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:19.925947 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4614b7e2-3ee2-4192-955f-702b965e2cc0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:19.926370 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4614b7e2-3ee2-4192-955f-702b965e2cc0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:19.927066 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4614b7e2-3ee2-4192-955f-702b965e2cc0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:19.927511 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4614b7e2-3ee2-4192-955f-702b965e2cc0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:19.927930 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4614b7e2-3ee2-4192-955f-702b965e2cc0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:19.955962 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-7afb72a6-0f2a-48f2-a834-eb83f668709d req-0d31ff74-1285-4244-a7ca-64f1a32449bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae", "name": "network-vif-unplugged", "status": "completed", "tag": "39f1800c-cf09-45ec-af04-2a341650fe20"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:30:19.968026 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7afb72a6-0f2a-48f2-a834-eb83f668709d req-0d31ff74-1285-4244-a7ca-64f1a32449bc service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:19.968832 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7afb72a6-0f2a-48f2-a834-eb83f668709d req-0d31ff74-1285-4244-a7ca-64f1a32449bc service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:19.969646 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7afb72a6-0f2a-48f2-a834-eb83f668709d req-0d31ff74-1285-4244-a7ca-64f1a32449bc service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:19.982046 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.compute.server_external_events [req-7afb72a6-0f2a-48f2-a834-eb83f668709d req-0d31ff74-1285-4244-a7ca-64f1a32449bc service nova] Unable to find a host for instance 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae. Dropping event network-vif-unplugged {{(pid=120663) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 28 10:30:19.983309 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-7afb72a6-0f2a-48f2-a834-eb83f668709d req-0d31ff74-1285-4244-a7ca-64f1a32449bc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031434 Aug 28 10:30:19.984223 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 631/1235] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 28 10:30:20.063430 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4614b7e2-3ee2-4192-955f-702b965e2cc0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:20.071641 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4614b7e2-3ee2-4192-955f-702b965e2cc0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1517 microversion: 2.1 time: 0.158294 Aug 28 10:30:20.072221 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 605/1236] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:19 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:21.092820 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c51470f9-ce3d-4ba4-b374-e50f6b43d9e9 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:21.093394 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c51470f9-ce3d-4ba4-b374-e50f6b43d9e9 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:21.100285 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c51470f9-ce3d-4ba4-b374-e50f6b43d9e9 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:21.100816 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c51470f9-ce3d-4ba4-b374-e50f6b43d9e9 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:21.101232 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c51470f9-ce3d-4ba4-b374-e50f6b43d9e9 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:21.101915 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c51470f9-ce3d-4ba4-b374-e50f6b43d9e9 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:21.102353 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c51470f9-ce3d-4ba4-b374-e50f6b43d9e9 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:21.102765 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c51470f9-ce3d-4ba4-b374-e50f6b43d9e9 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:21.308127 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c51470f9-ce3d-4ba4-b374-e50f6b43d9e9 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:21.316365 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c51470f9-ce3d-4ba4-b374-e50f6b43d9e9 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1573 microversion: 2.1 time: 0.227650 Aug 28 10:30:21.316961 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 632/1237] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:21 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1573 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:22.340717 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-9ec72a9b-c89e-4f23-a447-399016ef96dd tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:22.341691 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-9ec72a9b-c89e-4f23-a447-399016ef96dd tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:22.352564 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9ec72a9b-c89e-4f23-a447-399016ef96dd tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:22.353349 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9ec72a9b-c89e-4f23-a447-399016ef96dd tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:22.354046 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9ec72a9b-c89e-4f23-a447-399016ef96dd tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:22.355168 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9ec72a9b-c89e-4f23-a447-399016ef96dd tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:22.355891 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9ec72a9b-c89e-4f23-a447-399016ef96dd tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:22.356605 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-9ec72a9b-c89e-4f23-a447-399016ef96dd tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:22.494596 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-9ec72a9b-c89e-4f23-a447-399016ef96dd tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:22.502826 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-9ec72a9b-c89e-4f23-a447-399016ef96dd tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1573 microversion: 2.1 time: 0.168716 Aug 28 10:30:22.503407 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 606/1238] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:22 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1573 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:23.528537 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e5fff1d2-3844-4f20-b6c5-814f2e6e723c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:23.529582 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e5fff1d2-3844-4f20-b6c5-814f2e6e723c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:23.537281 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e5fff1d2-3844-4f20-b6c5-814f2e6e723c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:23.537793 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e5fff1d2-3844-4f20-b6c5-814f2e6e723c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:23.538219 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e5fff1d2-3844-4f20-b6c5-814f2e6e723c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:23.538912 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e5fff1d2-3844-4f20-b6c5-814f2e6e723c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:23.539361 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e5fff1d2-3844-4f20-b6c5-814f2e6e723c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:23.539779 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e5fff1d2-3844-4f20-b6c5-814f2e6e723c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:23.686186 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e5fff1d2-3844-4f20-b6c5-814f2e6e723c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:23.694419 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e5fff1d2-3844-4f20-b6c5-814f2e6e723c tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1573 microversion: 2.1 time: 0.172494 Aug 28 10:30:23.695037 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 633/1239] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:23 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1573 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:24.719449 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-7eeb0dc5-d2a4-4ac2-beac-d2dfad509b65 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:24.720096 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-7eeb0dc5-d2a4-4ac2-beac-d2dfad509b65 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:24.728119 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7eeb0dc5-d2a4-4ac2-beac-d2dfad509b65 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:24.728717 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7eeb0dc5-d2a4-4ac2-beac-d2dfad509b65 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:24.729209 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7eeb0dc5-d2a4-4ac2-beac-d2dfad509b65 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:24.729999 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7eeb0dc5-d2a4-4ac2-beac-d2dfad509b65 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:24.730516 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7eeb0dc5-d2a4-4ac2-beac-d2dfad509b65 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:24.730997 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-7eeb0dc5-d2a4-4ac2-beac-d2dfad509b65 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:24.866422 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-7eeb0dc5-d2a4-4ac2-beac-d2dfad509b65 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:24.876086 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-7eeb0dc5-d2a4-4ac2-beac-d2dfad509b65 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1573 microversion: 2.1 time: 0.163141 Aug 28 10:30:24.876724 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 607/1240] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:24 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:25.901489 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-233974d4-9bde-4783-9198-3a4e494373ce tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:25.902411 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-233974d4-9bde-4783-9198-3a4e494373ce tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:25.913558 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-233974d4-9bde-4783-9198-3a4e494373ce tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:25.914336 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-233974d4-9bde-4783-9198-3a4e494373ce tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:25.915031 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-233974d4-9bde-4783-9198-3a4e494373ce tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:25.916141 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-233974d4-9bde-4783-9198-3a4e494373ce tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:25.917105 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-233974d4-9bde-4783-9198-3a4e494373ce tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:25.917788 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-233974d4-9bde-4783-9198-3a4e494373ce tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:26.056144 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-233974d4-9bde-4783-9198-3a4e494373ce tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:26.064277 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-233974d4-9bde-4783-9198-3a4e494373ce tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1573 microversion: 2.1 time: 0.169384 Aug 28 10:30:26.064999 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 634/1241] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:25 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1573 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:27.091167 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-0a4e0e26-4efd-44a4-b622-7690bfc37aa6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:27.091917 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-0a4e0e26-4efd-44a4-b622-7690bfc37aa6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:27.099105 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0a4e0e26-4efd-44a4-b622-7690bfc37aa6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:27.099583 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0a4e0e26-4efd-44a4-b622-7690bfc37aa6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:27.100003 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0a4e0e26-4efd-44a4-b622-7690bfc37aa6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:27.100735 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0a4e0e26-4efd-44a4-b622-7690bfc37aa6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:27.101182 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0a4e0e26-4efd-44a4-b622-7690bfc37aa6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:27.101599 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-0a4e0e26-4efd-44a4-b622-7690bfc37aa6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:27.237596 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-0a4e0e26-4efd-44a4-b622-7690bfc37aa6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:27.249259 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-0a4e0e26-4efd-44a4-b622-7690bfc37aa6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1573 microversion: 2.1 time: 0.162463 Aug 28 10:30:27.250094 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 608/1242] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:27 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:28.271185 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-473523bd-a875-4abb-a193-d0a1b27cfbd0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:28.271802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-473523bd-a875-4abb-a193-d0a1b27cfbd0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:28.279289 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-473523bd-a875-4abb-a193-d0a1b27cfbd0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:28.279789 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-473523bd-a875-4abb-a193-d0a1b27cfbd0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:28.280209 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-473523bd-a875-4abb-a193-d0a1b27cfbd0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:28.280927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-473523bd-a875-4abb-a193-d0a1b27cfbd0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:28.281363 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-473523bd-a875-4abb-a193-d0a1b27cfbd0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:28.281774 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-473523bd-a875-4abb-a193-d0a1b27cfbd0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:28.423854 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-473523bd-a875-4abb-a193-d0a1b27cfbd0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:28.431812 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-473523bd-a875-4abb-a193-d0a1b27cfbd0 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1573 microversion: 2.1 time: 0.164905 Aug 28 10:30:28.432388 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 635/1243] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:28 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:29.453316 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-451f087d-0db8-42a9-a1ca-1d8c2c7b5e0b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:29.453855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-451f087d-0db8-42a9-a1ca-1d8c2c7b5e0b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:29.460169 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-451f087d-0db8-42a9-a1ca-1d8c2c7b5e0b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:29.460684 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-451f087d-0db8-42a9-a1ca-1d8c2c7b5e0b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:29.461105 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-451f087d-0db8-42a9-a1ca-1d8c2c7b5e0b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:29.461791 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-451f087d-0db8-42a9-a1ca-1d8c2c7b5e0b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:29.462225 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-451f087d-0db8-42a9-a1ca-1d8c2c7b5e0b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:29.462638 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-451f087d-0db8-42a9-a1ca-1d8c2c7b5e0b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:29.596738 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-451f087d-0db8-42a9-a1ca-1d8c2c7b5e0b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:29.605038 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-451f087d-0db8-42a9-a1ca-1d8c2c7b5e0b tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1573 microversion: 2.1 time: 0.155896 Aug 28 10:30:29.605605 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 609/1244] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:29 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:30.627787 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8d815531-ed89-4af4-ae6b-1b4a955ebff6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:30.628599 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8d815531-ed89-4af4-ae6b-1b4a955ebff6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:30.636810 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d815531-ed89-4af4-ae6b-1b4a955ebff6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:30.637317 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d815531-ed89-4af4-ae6b-1b4a955ebff6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:30.637821 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d815531-ed89-4af4-ae6b-1b4a955ebff6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:30.638620 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d815531-ed89-4af4-ae6b-1b4a955ebff6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:30.639066 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d815531-ed89-4af4-ae6b-1b4a955ebff6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:30.639484 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d815531-ed89-4af4-ae6b-1b4a955ebff6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:30.786508 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8d815531-ed89-4af4-ae6b-1b4a955ebff6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:30.795748 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8d815531-ed89-4af4-ae6b-1b4a955ebff6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1573 microversion: 2.1 time: 0.173253 Aug 28 10:30:30.796313 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 636/1245] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:30 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1573 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:31.817006 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-2999ab61-9fce-4231-9703-d402e45988ea tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:31.817628 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-2999ab61-9fce-4231-9703-d402e45988ea tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:31.825124 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2999ab61-9fce-4231-9703-d402e45988ea tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:31.825753 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2999ab61-9fce-4231-9703-d402e45988ea tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:31.826176 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2999ab61-9fce-4231-9703-d402e45988ea tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:31.826903 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2999ab61-9fce-4231-9703-d402e45988ea tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:31.827351 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2999ab61-9fce-4231-9703-d402e45988ea tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:31.827773 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-2999ab61-9fce-4231-9703-d402e45988ea tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:31.977234 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-2999ab61-9fce-4231-9703-d402e45988ea tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:31.983946 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-2999ab61-9fce-4231-9703-d402e45988ea tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1573 microversion: 2.1 time: 0.171014 Aug 28 10:30:31.987222 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 610/1246] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:31 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1573 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:32.063010 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-a26980ef-8f5e-4eb5-998c-513546493fb3 req-88318d43-dd6a-40c5-a34e-65138c4b5659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae", "name": "network-vif-plugged", "status": "completed", "tag": "39f1800c-cf09-45ec-af04-2a341650fe20"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:30:32.075345 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-a26980ef-8f5e-4eb5-998c-513546493fb3 req-88318d43-dd6a-40c5-a34e-65138c4b5659 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:32.075825 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-a26980ef-8f5e-4eb5-998c-513546493fb3 req-88318d43-dd6a-40c5-a34e-65138c4b5659 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:32.076310 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-a26980ef-8f5e-4eb5-998c-513546493fb3 req-88318d43-dd6a-40c5-a34e-65138c4b5659 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:32.089448 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-a26980ef-8f5e-4eb5-998c-513546493fb3 req-88318d43-dd6a-40c5-a34e-65138c4b5659 service nova] Creating event network-vif-plugged:39f1800c-cf09-45ec-af04-2a341650fe20 for instance 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae on hv-cinder-85200 Aug 28 10:30:32.095057 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-a26980ef-8f5e-4eb5-998c-513546493fb3 req-88318d43-dd6a-40c5-a34e-65138c4b5659 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035920 Aug 28 10:30:32.095915 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 637/1247] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:30:33.005773 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-debc87d1-a2c8-4770-aa5f-77dd42ad4fa8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:33.006376 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-debc87d1-a2c8-4770-aa5f-77dd42ad4fa8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:33.013730 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-debc87d1-a2c8-4770-aa5f-77dd42ad4fa8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:33.014230 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-debc87d1-a2c8-4770-aa5f-77dd42ad4fa8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:33.014652 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-debc87d1-a2c8-4770-aa5f-77dd42ad4fa8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:33.015339 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-debc87d1-a2c8-4770-aa5f-77dd42ad4fa8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:33.015800 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-debc87d1-a2c8-4770-aa5f-77dd42ad4fa8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:33.016265 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-debc87d1-a2c8-4770-aa5f-77dd42ad4fa8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:33.155920 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-debc87d1-a2c8-4770-aa5f-77dd42ad4fa8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:33.164464 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-debc87d1-a2c8-4770-aa5f-77dd42ad4fa8 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1573 microversion: 2.1 time: 0.162661 Aug 28 10:30:33.165692 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 611/1248] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:33 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:30:34.187516 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-854391fe-d174-46f4-b833-c51a43d01641 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:30:34.188164 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-854391fe-d174-46f4-b833-c51a43d01641 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:30:34.194730 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-854391fe-d174-46f4-b833-c51a43d01641 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:34.195209 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-854391fe-d174-46f4-b833-c51a43d01641 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:34.195635 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-854391fe-d174-46f4-b833-c51a43d01641 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:34.196323 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-854391fe-d174-46f4-b833-c51a43d01641 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:30:34.196807 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-854391fe-d174-46f4-b833-c51a43d01641 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:30:34.197228 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-854391fe-d174-46f4-b833-c51a43d01641 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:30:34.347124 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-854391fe-d174-46f4-b833-c51a43d01641 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:30:34.355293 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-854391fe-d174-46f4-b833-c51a43d01641 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1560 microversion: 2.1 time: 0.172426 Aug 28 10:30:34.355871 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 638/1249] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:30:34 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:31:03.131826 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-1bb3fe3a-dd15-4953-96d7-1da9c2243dff tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-336798658"}} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:31:03.132478 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-1bb3fe3a-dd15-4953-96d7-1da9c2243dff tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:03.134503 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:03.135144 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:03.141729 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1bb3fe3a-dd15-4953-96d7-1da9c2243dff tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:03.142208 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1bb3fe3a-dd15-4953-96d7-1da9c2243dff tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:03.142629 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1bb3fe3a-dd15-4953-96d7-1da9c2243dff tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:03.143319 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1bb3fe3a-dd15-4953-96d7-1da9c2243dff tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:03.143761 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1bb3fe3a-dd15-4953-96d7-1da9c2243dff tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:03.144171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-1bb3fe3a-dd15-4953-96d7-1da9c2243dff tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:03.328539 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.network.security_group_api [None req-1bb3fe3a-dd15-4953-96d7-1da9c2243dff tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Removing security group 79f90cea-155c-4021-91e2-ea47dda721f5 from port 8551ab95-1dbc-4704-8bcd-277aa9ca0c03 Aug 28 10:31:03.651015 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-1bb3fe3a-dd15-4953-96d7-1da9c2243dff tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "POST /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2/action" status: 202 len: 0 microversion: 2.1 time: 0.523235 Aug 28 10:31:03.655155 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 612/1250] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Aug 28 10:31:03 2022] POST /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:31:03.662927 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-eb9759ec-48b7-420e-afbf-8f7d64938d75 req-7e00ff22-8610-4b45-a72a-46c406911798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e63ee84e-611d-4899-a83c-3b95dd818ae2", "tag": "8551ab95-1dbc-4704-8bcd-277aa9ca0c03"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:31:03.668257 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=19 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:03.678665 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=51 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:03.692840 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-eb9759ec-48b7-420e-afbf-8f7d64938d75 req-7e00ff22-8610-4b45-a72a-46c406911798 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:03.693318 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-eb9759ec-48b7-420e-afbf-8f7d64938d75 req-7e00ff22-8610-4b45-a72a-46c406911798 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:03.693748 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-eb9759ec-48b7-420e-afbf-8f7d64938d75 req-7e00ff22-8610-4b45-a72a-46c406911798 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:03.709528 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-eb9759ec-48b7-420e-afbf-8f7d64938d75 req-7e00ff22-8610-4b45-a72a-46c406911798 service nova] Creating event network-changed:8551ab95-1dbc-4704-8bcd-277aa9ca0c03 for instance e63ee84e-611d-4899-a83c-3b95dd818ae2 on hv-cinder-85200 Aug 28 10:31:03.724523 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-eb9759ec-48b7-420e-afbf-8f7d64938d75 req-7e00ff22-8610-4b45-a72a-46c406911798 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059456 Aug 28 10:31:03.731204 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 639/1251] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:31:04.745433 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-28cc6e92-d682-45b4-a522-444e8435fc2d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:04.746038 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-28cc6e92-d682-45b4-a522-444e8435fc2d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:04.748317 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-3496de5b-fc1b-413c-b2f5-3fd26daa6261 req-ca34c8de-f708-4d5e-b2f8-1b8e42641cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e63ee84e-611d-4899-a83c-3b95dd818ae2", "tag": "8551ab95-1dbc-4704-8bcd-277aa9ca0c03"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:31:04.762730 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-3496de5b-fc1b-413c-b2f5-3fd26daa6261 req-ca34c8de-f708-4d5e-b2f8-1b8e42641cc4 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:04.764828 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-28cc6e92-d682-45b4-a522-444e8435fc2d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:04.765744 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-28cc6e92-d682-45b4-a522-444e8435fc2d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:04.766284 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-28cc6e92-d682-45b4-a522-444e8435fc2d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:04.766976 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-28cc6e92-d682-45b4-a522-444e8435fc2d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:04.767425 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-28cc6e92-d682-45b4-a522-444e8435fc2d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:04.768059 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-28cc6e92-d682-45b4-a522-444e8435fc2d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:04.769728 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-3496de5b-fc1b-413c-b2f5-3fd26daa6261 req-ca34c8de-f708-4d5e-b2f8-1b8e42641cc4 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:04.770145 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-3496de5b-fc1b-413c-b2f5-3fd26daa6261 req-ca34c8de-f708-4d5e-b2f8-1b8e42641cc4 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:04.796389 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-3496de5b-fc1b-413c-b2f5-3fd26daa6261 req-ca34c8de-f708-4d5e-b2f8-1b8e42641cc4 service nova] Creating event network-changed:8551ab95-1dbc-4704-8bcd-277aa9ca0c03 for instance e63ee84e-611d-4899-a83c-3b95dd818ae2 on hv-cinder-85200 Aug 28 10:31:04.804098 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-3496de5b-fc1b-413c-b2f5-3fd26daa6261 req-ca34c8de-f708-4d5e-b2f8-1b8e42641cc4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068079 Aug 28 10:31:04.804981 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 640/1252] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:31:04.875171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.objects.instance [None req-28cc6e92-d682-45b4-a522-444e8435fc2d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lazy-loading 'services' on Instance uuid e63ee84e-611d-4899-a83c-3b95dd818ae2 {{(pid=120664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:31:04.953799 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-28cc6e92-d682-45b4-a522-444e8435fc2d tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2/os-volume_attachments/5dc8613f-fb73-4821-92b9-49ff42d5fbbe" status: 202 len: 0 microversion: 2.1 time: 0.219929 Aug 28 10:31:04.954986 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 613/1253] 10.222.0.40 () {58 vars in 1416 bytes} [Sun Aug 28 10:31:04 2022] DELETE /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2/os-volume_attachments/5dc8613f-fb73-4821-92b9-49ff42d5fbbe => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:31:04.966405 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-099686cc-aed0-41ed-bba9-1b05c8eeb07c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:04.970597 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-099686cc-aed0-41ed-bba9-1b05c8eeb07c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:04.981699 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-099686cc-aed0-41ed-bba9-1b05c8eeb07c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:04.982841 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-099686cc-aed0-41ed-bba9-1b05c8eeb07c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:04.984121 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-099686cc-aed0-41ed-bba9-1b05c8eeb07c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:04.985681 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-099686cc-aed0-41ed-bba9-1b05c8eeb07c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:04.986601 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-099686cc-aed0-41ed-bba9-1b05c8eeb07c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:04.987418 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-099686cc-aed0-41ed-bba9-1b05c8eeb07c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:05.033730 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-099686cc-aed0-41ed-bba9-1b05c8eeb07c tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072709 Aug 28 10:31:05.039883 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 641/1254] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Aug 28 10:31:04 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:31:05.540039 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-94856d28-1d97-4678-932c-2df11e14da60 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:05.540899 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-94856d28-1d97-4678-932c-2df11e14da60 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:05.548089 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-94856d28-1d97-4678-932c-2df11e14da60 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:05.548600 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-94856d28-1d97-4678-932c-2df11e14da60 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:05.549033 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-94856d28-1d97-4678-932c-2df11e14da60 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:05.549733 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-94856d28-1d97-4678-932c-2df11e14da60 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:05.550176 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-94856d28-1d97-4678-932c-2df11e14da60 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:05.550818 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-94856d28-1d97-4678-932c-2df11e14da60 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:05.578703 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-94856d28-1d97-4678-932c-2df11e14da60 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Going to try to terminate instance {{(pid=120664) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 28 10:31:05.730744 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-94856d28-1d97-4678-932c-2df11e14da60 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "DELETE /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 204 len: 0 microversion: 2.1 time: 0.194356 Aug 28 10:31:05.735011 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 614/1255] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:31:05 2022] DELETE /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 28 10:31:05.743201 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c507e1cb-8cc3-4633-98dd-032575e9c7e9 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:05.744493 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c507e1cb-8cc3-4633-98dd-032575e9c7e9 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:05.754977 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c507e1cb-8cc3-4633-98dd-032575e9c7e9 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:05.756044 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c507e1cb-8cc3-4633-98dd-032575e9c7e9 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:05.756532 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c507e1cb-8cc3-4633-98dd-032575e9c7e9 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:05.762765 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c507e1cb-8cc3-4633-98dd-032575e9c7e9 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:05.762961 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-408d7375-a68d-4394-b070-838384f4b1d7 req-e9d364c5-c68f-4485-8fde-2be4185249a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63c1366d-54f7-4160-8e1a-96d551dd184b", "tag": "3847d05c-508c-4228-b2da-1f89bd39eed0"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:31:05.765754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c507e1cb-8cc3-4633-98dd-032575e9c7e9 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:05.766513 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c507e1cb-8cc3-4633-98dd-032575e9c7e9 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:05.774804 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-408d7375-a68d-4394-b070-838384f4b1d7 req-e9d364c5-c68f-4485-8fde-2be4185249a6 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:05.775276 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-408d7375-a68d-4394-b070-838384f4b1d7 req-e9d364c5-c68f-4485-8fde-2be4185249a6 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:05.776018 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-408d7375-a68d-4394-b070-838384f4b1d7 req-e9d364c5-c68f-4485-8fde-2be4185249a6 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:05.791383 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-408d7375-a68d-4394-b070-838384f4b1d7 req-e9d364c5-c68f-4485-8fde-2be4185249a6 service nova] Creating event network-changed:3847d05c-508c-4228-b2da-1f89bd39eed0 for instance 63c1366d-54f7-4160-8e1a-96d551dd184b on hv-cinder-85200 Aug 28 10:31:05.797368 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-408d7375-a68d-4394-b070-838384f4b1d7 req-e9d364c5-c68f-4485-8fde-2be4185249a6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040791 Aug 28 10:31:05.798218 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 615/1256] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:31:05.970525 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c507e1cb-8cc3-4633-98dd-032575e9c7e9 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:31:05.979157 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c507e1cb-8cc3-4633-98dd-032575e9c7e9 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1574 microversion: 2.1 time: 0.239917 Aug 28 10:31:05.980542 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 642/1257] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:31:05 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1574 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:31:06.048380 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-18b05c0d-4af4-4820-9c85-06d98523933b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:06.050896 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-18b05c0d-4af4-4820-9c85-06d98523933b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:06.057596 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-18b05c0d-4af4-4820-9c85-06d98523933b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:06.058077 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-18b05c0d-4af4-4820-9c85-06d98523933b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:06.058505 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-18b05c0d-4af4-4820-9c85-06d98523933b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:06.059383 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-18b05c0d-4af4-4820-9c85-06d98523933b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:06.059828 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-18b05c0d-4af4-4820-9c85-06d98523933b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:06.060244 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-18b05c0d-4af4-4820-9c85-06d98523933b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:06.089995 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-18b05c0d-4af4-4820-9c85-06d98523933b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046351 Aug 28 10:31:06.090767 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 616/1258] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Aug 28 10:31:06 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:31:07.000349 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4d7f474a-95aa-4233-9355-ba8e40b4ef43 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:07.001014 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4d7f474a-95aa-4233-9355-ba8e40b4ef43 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:07.007947 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d7f474a-95aa-4233-9355-ba8e40b4ef43 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:07.008424 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d7f474a-95aa-4233-9355-ba8e40b4ef43 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:07.008903 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d7f474a-95aa-4233-9355-ba8e40b4ef43 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:07.009616 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d7f474a-95aa-4233-9355-ba8e40b4ef43 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:07.010062 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d7f474a-95aa-4233-9355-ba8e40b4ef43 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:07.010478 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d7f474a-95aa-4233-9355-ba8e40b4ef43 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:07.102757 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8859f9d8-2bfc-49c6-8777-7175e58e138f tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:07.105229 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-8859f9d8-2bfc-49c6-8777-7175e58e138f tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:07.114040 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8859f9d8-2bfc-49c6-8777-7175e58e138f tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:07.114592 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8859f9d8-2bfc-49c6-8777-7175e58e138f tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:07.115193 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8859f9d8-2bfc-49c6-8777-7175e58e138f tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:07.115916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8859f9d8-2bfc-49c6-8777-7175e58e138f tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:07.116435 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8859f9d8-2bfc-49c6-8777-7175e58e138f tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:07.116934 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8859f9d8-2bfc-49c6-8777-7175e58e138f tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:07.146978 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-8859f9d8-2bfc-49c6-8777-7175e58e138f tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048270 Aug 28 10:31:07.147537 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 617/1259] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Aug 28 10:31:07 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 28 10:31:07.157672 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-22ee0ace-c873-4bd8-a820-706dedeb467e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:07.158154 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-22ee0ace-c873-4bd8-a820-706dedeb467e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:07.164032 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-22ee0ace-c873-4bd8-a820-706dedeb467e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:07.164533 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-22ee0ace-c873-4bd8-a820-706dedeb467e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:07.164951 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-22ee0ace-c873-4bd8-a820-706dedeb467e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:07.165632 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-22ee0ace-c873-4bd8-a820-706dedeb467e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:07.166067 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-22ee0ace-c873-4bd8-a820-706dedeb467e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:07.166480 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-22ee0ace-c873-4bd8-a820-706dedeb467e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:07.172545 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4d7f474a-95aa-4233-9355-ba8e40b4ef43 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:31:07.180526 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4d7f474a-95aa-4233-9355-ba8e40b4ef43 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1574 microversion: 2.1 time: 0.184068 Aug 28 10:31:07.181489 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 643/1260] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:31:06 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1574 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:31:07.245544 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-22ee0ace-c873-4bd8-a820-706dedeb467e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] HTTP exception thrown: Instance e63ee84e-611d-4899-a83c-3b95dd818ae2 is not attached to volume 5dc8613f-fb73-4821-92b9-49ff42d5fbbe Aug 28 10:31:07.247916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-22ee0ace-c873-4bd8-a820-706dedeb467e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Request method failure captured: Aug 28 10:31:07.247916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: DELETE /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2/os-volume_attachments/5dc8613f-fb73-4821-92b9-49ff42d5fbbe HTTP/1.1 Aug 28 10:31:07.247916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:31:07.247916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:31:07.247916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:31:07.247916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:31:07.247916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:31:07.247916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:31:07.247916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:31:07.247916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:31:07.247916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0MYYEtqRr6bNd06pesNbmGJ5PdykevD0p5kfvjsyGGJnFz5-JBrsi1VN32LSurn4C4ar4Aoj0Xe_TZIssedONtkB2Q0ElTuymxiDyr8IPWH5umiBThCnvArFu8t0nzHp_HapnTwBO8QQUB54KLGhSRX08_QZ5HQUGu0pmOxFb9KH9A Aug 28 10:31:07.247916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:31:07.247916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:31:07.247916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:31:07.247916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:31:07.247916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:31:07.247916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:31:07.247916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: d82620aefc2f4df9a5aa6492c2786385 Aug 28 10:31:07.247916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-TestMinimumBasicScenario-158406222 Aug 28 10:31:07.247916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:31:07.247916 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:31:07.249715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d82620aefc2f4df9a5aa6492c2786385", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d82620aefc2f4df9a5aa6492c2786385"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d82620aefc2f4df9a5aa6492c2786385"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d82620aefc2f4df9a5aa6492c2786385"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:31:07.249715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-TestMinimumBasicScenario-158406222 Aug 28 10:31:07.249715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: d82620aefc2f4df9a5aa6492c2786385 Aug 28 10:31:07.249715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-TestMinimumBasicScenario-158406222 Aug 28 10:31:07.249715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-TestMinimumBasicScenario-158406222-project Aug 28 10:31:07.249715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:31:07.249715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:31:07.249715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: 8e56cbeb9e4f46ffa262c788a61e4bf4 Aug 28 10:31:07.249715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-TestMinimumBasicScenario-158406222-project Aug 28 10:31:07.249715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: > Aug 28 10:31:07.249715 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Instance e63ee84e-611d-4899-a83c-3b95dd818ae2 is not attached to volume 5dc8613f-fb73-4821-92b9-49ff42d5fbbe Aug 28 10:31:07.250702 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'server_id': 'e63ee84e-611d-4899-a83c-3b95dd818ae2', 'id': '5dc8613f-fb73-4821-92b9-49ff42d5fbbe'} Aug 28 10:31:07.250702 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:31:07.250702 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:31:07.250702 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 28 10:31:07.250702 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 28 10:31:07.250702 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 28 10:31:07.250702 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 28 10:31:07.250702 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 28 10:31:07.250702 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 28 10:31:07.250702 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5dc8613f-fb73-4821-92b9-49ff42d5fbbe. Aug 28 10:31:07.250702 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:31:07.250702 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:31:07.250702 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:31:07.250702 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:31:07.250702 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:31:07.250702 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:31:07.250702 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:31:07.250702 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:31:07.250702 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:31:07.252369 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:31:07.252369 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 28 10:31:07.252369 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 28 10:31:07.252369 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e63ee84e-611d-4899-a83c-3b95dd818ae2 is not attached to volume 5dc8613f-fb73-4821-92b9-49ff42d5fbbe Aug 28 10:31:07.252369 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:31:07.252369 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:31:07.252369 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:31:07.252369 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:31:07.252369 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:31:07.252369 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:31:07.252369 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:31:07.252369 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:31:07.252369 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e63ee84e-611d-4899-a83c-3b95dd818ae2 is not attached to volume 5dc8613f-fb73-4821-92b9-49ff42d5fbbe Aug 28 10:31:07.252369 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:31:07.252369 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-22ee0ace-c873-4bd8-a820-706dedeb467e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Returning 404 to user: Instance e63ee84e-611d-4899-a83c-3b95dd818ae2 is not attached to volume 5dc8613f-fb73-4821-92b9-49ff42d5fbbe {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:31:07.253574 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-22ee0ace-c873-4bd8-a820-706dedeb467e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2/os-volume_attachments/5dc8613f-fb73-4821-92b9-49ff42d5fbbe" status: 404 len: 154 microversion: 2.1 time: 0.095525 Aug 28 10:31:07.253574 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 618/1261] 10.222.0.40 () {58 vars in 1416 bytes} [Sun Aug 28 10:31:07 2022] DELETE /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2/os-volume_attachments/5dc8613f-fb73-4821-92b9-49ff42d5fbbe => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 28 10:31:08.125445 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-6ff33921-7ea9-4702-a109-eae2ee1a34e7 req-93ecd7f3-ecae-4e67-8ccc-1ec1adf4d834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c1366d-54f7-4160-8e1a-96d551dd184b", "name": "network-vif-deleted", "tag": "3847d05c-508c-4228-b2da-1f89bd39eed0"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:31:08.137471 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-6ff33921-7ea9-4702-a109-eae2ee1a34e7 req-93ecd7f3-ecae-4e67-8ccc-1ec1adf4d834 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:08.137939 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-6ff33921-7ea9-4702-a109-eae2ee1a34e7 req-93ecd7f3-ecae-4e67-8ccc-1ec1adf4d834 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:08.138359 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-6ff33921-7ea9-4702-a109-eae2ee1a34e7 req-93ecd7f3-ecae-4e67-8ccc-1ec1adf4d834 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:08.149415 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-6ff33921-7ea9-4702-a109-eae2ee1a34e7 req-93ecd7f3-ecae-4e67-8ccc-1ec1adf4d834 service nova] Creating event network-vif-deleted:3847d05c-508c-4228-b2da-1f89bd39eed0 for instance 63c1366d-54f7-4160-8e1a-96d551dd184b on hv-cinder-85200 Aug 28 10:31:08.154303 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-6ff33921-7ea9-4702-a109-eae2ee1a34e7 req-93ecd7f3-ecae-4e67-8ccc-1ec1adf4d834 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032599 Aug 28 10:31:08.154890 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 644/1262] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:31:08.202867 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-61ae85b6-2814-4f6d-8cd6-45c2608c1772 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:08.203465 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-61ae85b6-2814-4f6d-8cd6-45c2608c1772 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:08.210427 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61ae85b6-2814-4f6d-8cd6-45c2608c1772 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:08.210914 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61ae85b6-2814-4f6d-8cd6-45c2608c1772 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:08.211337 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61ae85b6-2814-4f6d-8cd6-45c2608c1772 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:08.212023 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61ae85b6-2814-4f6d-8cd6-45c2608c1772 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:08.212459 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61ae85b6-2814-4f6d-8cd6-45c2608c1772 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:08.212946 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-61ae85b6-2814-4f6d-8cd6-45c2608c1772 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:08.276546 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-61ae85b6-2814-4f6d-8cd6-45c2608c1772 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:31:08.284535 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-61ae85b6-2814-4f6d-8cd6-45c2608c1772 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1224 microversion: 2.1 time: 0.085688 Aug 28 10:31:08.285183 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 619/1263] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:31:08 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:31:08.408396 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7dee465e-4119-42e9-9a6b-49fe4704340b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:08.409068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7dee465e-4119-42e9-9a6b-49fe4704340b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:08.415758 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7dee465e-4119-42e9-9a6b-49fe4704340b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:08.416244 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7dee465e-4119-42e9-9a6b-49fe4704340b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:08.416765 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7dee465e-4119-42e9-9a6b-49fe4704340b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:08.417470 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7dee465e-4119-42e9-9a6b-49fe4704340b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:08.417921 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7dee465e-4119-42e9-9a6b-49fe4704340b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:08.418375 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7dee465e-4119-42e9-9a6b-49fe4704340b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:08.449165 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7dee465e-4119-42e9-9a6b-49fe4704340b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 28 10:31:08.543700 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7dee465e-4119-42e9-9a6b-49fe4704340b tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 204 len: 0 microversion: 2.1 time: 0.138863 Aug 28 10:31:08.544300 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 645/1264] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:31:08 2022] DELETE /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 28 10:31:08.552956 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-c1dbbe86-5c72-466e-85c0-fe8d3d4a21a2 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:08.553567 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-c1dbbe86-5c72-466e-85c0-fe8d3d4a21a2 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:08.560075 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c1dbbe86-5c72-466e-85c0-fe8d3d4a21a2 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:08.560589 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c1dbbe86-5c72-466e-85c0-fe8d3d4a21a2 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:08.561019 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c1dbbe86-5c72-466e-85c0-fe8d3d4a21a2 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:08.561870 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c1dbbe86-5c72-466e-85c0-fe8d3d4a21a2 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:08.562363 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c1dbbe86-5c72-466e-85c0-fe8d3d4a21a2 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:08.562868 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-c1dbbe86-5c72-466e-85c0-fe8d3d4a21a2 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:08.698429 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-c1dbbe86-5c72-466e-85c0-fe8d3d4a21a2 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:31:08.709620 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-c1dbbe86-5c72-466e-85c0-fe8d3d4a21a2 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1555 microversion: 2.1 time: 0.160394 Aug 28 10:31:08.710330 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 620/1265] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:31:08 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:31:09.308052 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d2665998-6caf-4baf-ab3e-a61af1d1b036 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:09.308980 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d2665998-6caf-4baf-ab3e-a61af1d1b036 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:09.317802 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2665998-6caf-4baf-ab3e-a61af1d1b036 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:09.318429 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2665998-6caf-4baf-ab3e-a61af1d1b036 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:09.318990 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2665998-6caf-4baf-ab3e-a61af1d1b036 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:09.319888 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2665998-6caf-4baf-ab3e-a61af1d1b036 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:09.320475 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2665998-6caf-4baf-ab3e-a61af1d1b036 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:09.321052 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2665998-6caf-4baf-ab3e-a61af1d1b036 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:09.356175 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2665998-6caf-4baf-ab3e-a61af1d1b036 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:09.356680 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2665998-6caf-4baf-ab3e-a61af1d1b036 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:09.357098 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2665998-6caf-4baf-ab3e-a61af1d1b036 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:09.357524 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-d2665998-6caf-4baf-ab3e-a61af1d1b036 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lazy-loading 'fault' on Instance uuid 63c1366d-54f7-4160-8e1a-96d551dd184b {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:31:09.399148 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d2665998-6caf-4baf-ab3e-a61af1d1b036 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:31:09.407140 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d2665998-6caf-4baf-ab3e-a61af1d1b036 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1229 microversion: 2.1 time: 0.104050 Aug 28 10:31:09.407719 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 646/1266] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:31:09 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1229 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:31:09.732830 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-159e6278-26f5-4e13-8ec6-79443351242a tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:09.733492 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-159e6278-26f5-4e13-8ec6-79443351242a tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:09.741003 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-159e6278-26f5-4e13-8ec6-79443351242a tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:09.741526 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-159e6278-26f5-4e13-8ec6-79443351242a tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:09.741986 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-159e6278-26f5-4e13-8ec6-79443351242a tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:09.742738 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-159e6278-26f5-4e13-8ec6-79443351242a tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:09.743226 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-159e6278-26f5-4e13-8ec6-79443351242a tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:09.743683 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-159e6278-26f5-4e13-8ec6-79443351242a tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:09.874349 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-159e6278-26f5-4e13-8ec6-79443351242a tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:31:09.882765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-159e6278-26f5-4e13-8ec6-79443351242a tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1555 microversion: 2.1 time: 0.154341 Aug 28 10:31:09.883332 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 621/1267] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:31:09 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:31:10.432627 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-54dc465e-f137-4381-afd5-1ec711071cf3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:10.433467 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-54dc465e-f137-4381-afd5-1ec711071cf3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:10.444310 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54dc465e-f137-4381-afd5-1ec711071cf3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:10.445165 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54dc465e-f137-4381-afd5-1ec711071cf3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:10.446076 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54dc465e-f137-4381-afd5-1ec711071cf3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:10.446887 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54dc465e-f137-4381-afd5-1ec711071cf3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:10.447337 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54dc465e-f137-4381-afd5-1ec711071cf3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:10.447754 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54dc465e-f137-4381-afd5-1ec711071cf3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:10.479266 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54dc465e-f137-4381-afd5-1ec711071cf3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:10.479735 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54dc465e-f137-4381-afd5-1ec711071cf3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:10.480160 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54dc465e-f137-4381-afd5-1ec711071cf3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:10.480635 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-54dc465e-f137-4381-afd5-1ec711071cf3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lazy-loading 'fault' on Instance uuid 63c1366d-54f7-4160-8e1a-96d551dd184b {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:31:10.522245 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-54dc465e-f137-4381-afd5-1ec711071cf3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:31:10.531289 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-54dc465e-f137-4381-afd5-1ec711071cf3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 200 len: 1229 microversion: 2.1 time: 0.105173 Aug 28 10:31:10.532144 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 647/1268] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:31:10 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 1229 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:31:10.907554 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-e90e6eeb-82c4-4064-89bd-9baebf9567ff tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:10.908568 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-e90e6eeb-82c4-4064-89bd-9baebf9567ff tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:10.919231 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e90e6eeb-82c4-4064-89bd-9baebf9567ff tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:10.920421 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e90e6eeb-82c4-4064-89bd-9baebf9567ff tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:10.921170 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e90e6eeb-82c4-4064-89bd-9baebf9567ff tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:10.922286 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e90e6eeb-82c4-4064-89bd-9baebf9567ff tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:10.923015 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e90e6eeb-82c4-4064-89bd-9baebf9567ff tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:10.923700 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-e90e6eeb-82c4-4064-89bd-9baebf9567ff tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:11.144626 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-e90e6eeb-82c4-4064-89bd-9baebf9567ff tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:31:11.152895 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-e90e6eeb-82c4-4064-89bd-9baebf9567ff tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1555 microversion: 2.1 time: 0.252172 Aug 28 10:31:11.153466 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 622/1269] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:31:10 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1555 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:31:11.484635 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-7974d380-b612-4cff-aeaf-52bbd40f95f2 req-a9b91eb3-1d4c-49c9-8d18-e8ec447fb2ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63ee84e-611d-4899-a83c-3b95dd818ae2", "name": "network-vif-deleted", "tag": "8551ab95-1dbc-4704-8bcd-277aa9ca0c03"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:31:11.496654 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7974d380-b612-4cff-aeaf-52bbd40f95f2 req-a9b91eb3-1d4c-49c9-8d18-e8ec447fb2ff service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:11.497126 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7974d380-b612-4cff-aeaf-52bbd40f95f2 req-a9b91eb3-1d4c-49c9-8d18-e8ec447fb2ff service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:11.497551 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7974d380-b612-4cff-aeaf-52bbd40f95f2 req-a9b91eb3-1d4c-49c9-8d18-e8ec447fb2ff service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:11.508591 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-7974d380-b612-4cff-aeaf-52bbd40f95f2 req-a9b91eb3-1d4c-49c9-8d18-e8ec447fb2ff service nova] Creating event network-vif-deleted:8551ab95-1dbc-4704-8bcd-277aa9ca0c03 for instance e63ee84e-611d-4899-a83c-3b95dd818ae2 on hv-cinder-85200 Aug 28 10:31:11.513426 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-7974d380-b612-4cff-aeaf-52bbd40f95f2 req-a9b91eb3-1d4c-49c9-8d18-e8ec447fb2ff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032517 Aug 28 10:31:11.514009 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 648/1270] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:31:11.555545 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-35a952d3-69d8-4260-b477-2c4c2464f2c3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:11.556187 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-35a952d3-69d8-4260-b477-2c4c2464f2c3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 63c1366d-54f7-4160-8e1a-96d551dd184b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:11.562620 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-35a952d3-69d8-4260-b477-2c4c2464f2c3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:11.563077 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-35a952d3-69d8-4260-b477-2c4c2464f2c3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:11.563535 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-35a952d3-69d8-4260-b477-2c4c2464f2c3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:11.564553 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-35a952d3-69d8-4260-b477-2c4c2464f2c3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:11.564995 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-35a952d3-69d8-4260-b477-2c4c2464f2c3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:11.565449 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-35a952d3-69d8-4260-b477-2c4c2464f2c3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:11.586532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-35a952d3-69d8-4260-b477-2c4c2464f2c3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] HTTP exception thrown: Instance 63c1366d-54f7-4160-8e1a-96d551dd184b could not be found. Aug 28 10:31:11.589392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-35a952d3-69d8-4260-b477-2c4c2464f2c3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Request method failure captured: Aug 28 10:31:11.589392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b HTTP/1.1 Aug 28 10:31:11.589392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:31:11.589392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:31:11.589392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:31:11.589392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:31:11.589392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:31:11.589392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:31:11.589392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:31:11.589392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:31:11.589392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0HTQZUOEwO5Qxo8TKaE1k29hFxRdBVXdLf-FAAa9VAs64CflXSgjlm6gvIGeVncZ1GkZbGZeCyoZzZmQ1FfLUjGWbMtylqhLcOqeawFD5n9A_b9VuahU95qV4H-g4QOhKuFk93vAeakTA71WUCg7U3WEYRUaup3HOfv9A9GZp6EkOA Aug 28 10:31:11.589392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:31:11.589392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:31:11.589392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:31:11.589392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:31:11.589392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:31:11.589392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:31:11.589392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: af70fccdef544a499725509ccd8c545f Aug 28 10:31:11.589392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-TestVolumeBootPattern-1181474048 Aug 28 10:31:11.589392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:31:11.589392 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:31:11.590908 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af70fccdef544a499725509ccd8c545f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af70fccdef544a499725509ccd8c545f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af70fccdef544a499725509ccd8c545f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af70fccdef544a499725509ccd8c545f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:31:11.590908 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-TestVolumeBootPattern-1181474048 Aug 28 10:31:11.590908 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: af70fccdef544a499725509ccd8c545f Aug 28 10:31:11.590908 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-TestVolumeBootPattern-1181474048 Aug 28 10:31:11.590908 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-TestVolumeBootPattern-1181474048-project Aug 28 10:31:11.590908 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:31:11.590908 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:31:11.590908 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: 3deb7adb33004f1097574470754611ec Aug 28 10:31:11.590908 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-TestVolumeBootPattern-1181474048-project Aug 28 10:31:11.590908 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: > Aug 28 10:31:11.590908 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Instance 63c1366d-54f7-4160-8e1a-96d551dd184b could not be found. Aug 28 10:31:11.590908 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': '63c1366d-54f7-4160-8e1a-96d551dd184b'} Aug 28 10:31:11.591855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:31:11.591855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:31:11.591855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:31:11.591855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:31:11.591855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:31:11.591855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:31:11.591855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:31:11.591855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:31:11.591855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:31:11.591855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:31:11.591855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63c1366d-54f7-4160-8e1a-96d551dd184b could not be found. Aug 28 10:31:11.591855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:31:11.591855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:31:11.591855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:31:11.591855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:31:11.591855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:31:11.591855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:31:11.591855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:31:11.591855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:31:11.591855 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:31:11.593469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:31:11.593469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:31:11.593469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:31:11.593469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:31:11.593469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:31:11.593469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:31:11.593469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:31:11.593469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63c1366d-54f7-4160-8e1a-96d551dd184b could not be found. Aug 28 10:31:11.593469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:31:11.593469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:31:11.593469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:31:11.593469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:31:11.593469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:31:11.593469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:31:11.593469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:31:11.593469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:31:11.593469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63c1366d-54f7-4160-8e1a-96d551dd184b could not be found. Aug 28 10:31:11.593469 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:31:11.594905 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-35a952d3-69d8-4260-b477-2c4c2464f2c3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Returning 404 to user: Instance 63c1366d-54f7-4160-8e1a-96d551dd184b could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:31:11.594905 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-35a952d3-69d8-4260-b477-2c4c2464f2c3 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b" status: 404 len: 111 microversion: 2.1 time: 0.038091 Aug 28 10:31:11.594905 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 623/1271] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:31:11 2022] GET /compute/v2.1/servers/63c1366d-54f7-4160-8e1a-96d551dd184b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:31:12.178894 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-24dbca55-5e10-41fe-adf8-4a20ebfb28bc tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:12.180036 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-24dbca55-5e10-41fe-adf8-4a20ebfb28bc tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:12.187173 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24dbca55-5e10-41fe-adf8-4a20ebfb28bc tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:12.187650 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24dbca55-5e10-41fe-adf8-4a20ebfb28bc tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:12.188100 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24dbca55-5e10-41fe-adf8-4a20ebfb28bc tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:12.188900 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24dbca55-5e10-41fe-adf8-4a20ebfb28bc tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:12.189237 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24dbca55-5e10-41fe-adf8-4a20ebfb28bc tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:12.189656 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24dbca55-5e10-41fe-adf8-4a20ebfb28bc tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:12.222790 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24dbca55-5e10-41fe-adf8-4a20ebfb28bc tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:12.223257 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24dbca55-5e10-41fe-adf8-4a20ebfb28bc tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:12.223682 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24dbca55-5e10-41fe-adf8-4a20ebfb28bc tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:12.224168 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-24dbca55-5e10-41fe-adf8-4a20ebfb28bc tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lazy-loading 'fault' on Instance uuid e63ee84e-611d-4899-a83c-3b95dd818ae2 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:31:12.266110 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-24dbca55-5e10-41fe-adf8-4a20ebfb28bc tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e56cbeb9e4f46ffa262c788a61e4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82620aefc2f4df9a5aa6492c2786385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:31:12.273877 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-24dbca55-5e10-41fe-adf8-4a20ebfb28bc tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 200 len: 1348 microversion: 2.1 time: 0.101944 Aug 28 10:31:12.274492 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 649/1272] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:31:12 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 1348 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:31:13.298530 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-eca17a52-7041-4bd8-9d7f-7543b059178e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:13.299518 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-eca17a52-7041-4bd8-9d7f-7543b059178e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [instance: e63ee84e-611d-4899-a83c-3b95dd818ae2] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:13.316443 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-eca17a52-7041-4bd8-9d7f-7543b059178e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:13.318612 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-eca17a52-7041-4bd8-9d7f-7543b059178e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:13.319335 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-eca17a52-7041-4bd8-9d7f-7543b059178e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:13.320472 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-eca17a52-7041-4bd8-9d7f-7543b059178e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:13.321258 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-eca17a52-7041-4bd8-9d7f-7543b059178e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:13.321814 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-eca17a52-7041-4bd8-9d7f-7543b059178e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:13.335671 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-eca17a52-7041-4bd8-9d7f-7543b059178e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] HTTP exception thrown: Instance e63ee84e-611d-4899-a83c-3b95dd818ae2 could not be found. Aug 28 10:31:13.337241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-eca17a52-7041-4bd8-9d7f-7543b059178e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Request method failure captured: Aug 28 10:31:13.337241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 HTTP/1.1 Aug 28 10:31:13.337241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:31:13.337241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:31:13.337241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:31:13.337241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:31:13.337241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:31:13.337241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:31:13.337241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:31:13.337241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:31:13.337241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0MYYEtqRr6bNd06pesNbmGJ5PdykevD0p5kfvjsyGGJnFz5-JBrsi1VN32LSurn4C4ar4Aoj0Xe_TZIssedONtkB2Q0ElTuymxiDyr8IPWH5umiBThCnvArFu8t0nzHp_HapnTwBO8QQUB54KLGhSRX08_QZ5HQUGu0pmOxFb9KH9A Aug 28 10:31:13.337241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:31:13.337241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:31:13.337241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:31:13.337241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:31:13.337241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:31:13.337241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:31:13.337241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: d82620aefc2f4df9a5aa6492c2786385 Aug 28 10:31:13.337241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-TestMinimumBasicScenario-158406222 Aug 28 10:31:13.337241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:31:13.337241 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:31:13.338931 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d82620aefc2f4df9a5aa6492c2786385", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d82620aefc2f4df9a5aa6492c2786385"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d82620aefc2f4df9a5aa6492c2786385"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d82620aefc2f4df9a5aa6492c2786385"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:31:13.338931 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-TestMinimumBasicScenario-158406222 Aug 28 10:31:13.338931 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: d82620aefc2f4df9a5aa6492c2786385 Aug 28 10:31:13.338931 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-TestMinimumBasicScenario-158406222 Aug 28 10:31:13.338931 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-TestMinimumBasicScenario-158406222-project Aug 28 10:31:13.338931 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:31:13.338931 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:31:13.338931 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: 8e56cbeb9e4f46ffa262c788a61e4bf4 Aug 28 10:31:13.338931 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-TestMinimumBasicScenario-158406222-project Aug 28 10:31:13.338931 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: > Aug 28 10:31:13.338931 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Instance e63ee84e-611d-4899-a83c-3b95dd818ae2 could not be found. Aug 28 10:31:13.338931 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': 'e63ee84e-611d-4899-a83c-3b95dd818ae2'} Aug 28 10:31:13.339894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:31:13.339894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:31:13.339894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:31:13.339894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:31:13.339894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:31:13.339894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:31:13.339894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:31:13.339894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:31:13.339894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:31:13.339894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:31:13.339894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e63ee84e-611d-4899-a83c-3b95dd818ae2 could not be found. Aug 28 10:31:13.339894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:31:13.339894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:31:13.339894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:31:13.339894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:31:13.339894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:31:13.339894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:31:13.339894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:31:13.339894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:31:13.339894 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:31:13.341559 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:31:13.341559 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:31:13.341559 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:31:13.341559 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:31:13.341559 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:31:13.341559 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:31:13.341559 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:31:13.341559 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e63ee84e-611d-4899-a83c-3b95dd818ae2 could not be found. Aug 28 10:31:13.341559 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:31:13.341559 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:31:13.341559 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:31:13.341559 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:31:13.341559 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:31:13.341559 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:31:13.341559 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:31:13.341559 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:31:13.341559 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e63ee84e-611d-4899-a83c-3b95dd818ae2 could not be found. Aug 28 10:31:13.341559 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:31:13.342920 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-eca17a52-7041-4bd8-9d7f-7543b059178e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Returning 404 to user: Instance e63ee84e-611d-4899-a83c-3b95dd818ae2 could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:31:13.342920 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-eca17a52-7041-4bd8-9d7f-7543b059178e tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2" status: 404 len: 111 microversion: 2.1 time: 0.046946 Aug 28 10:31:13.342920 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 624/1273] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:31:13 2022] GET /compute/v2.1/servers/e63ee84e-611d-4899-a83c-3b95dd818ae2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:31:13.348244 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3675c4a9-a737-4a04-acf4-201e166bc139 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] Calling method '.version_select at 0x7f7a1c1428b0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:13.352687 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3675c4a9-a737-4a04-acf4-201e166bc139 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [5bf4b604-c4b8-48d8-8e43-cde04e007d73] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 28 10:31:14.362045 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO oslo.messaging._drivers.impl_rabbit [None req-3675c4a9-a737-4a04-acf4-201e166bc139 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] [5bf4b604-c4b8-48d8-8e43-cde04e007d73] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 59354. Aug 28 10:31:14.384154 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3675c4a9-a737-4a04-acf4-201e166bc139 tempest-TestMinimumBasicScenario-158406222 tempest-TestMinimumBasicScenario-158406222-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1204136317" status: 202 len: 0 microversion: 2.1 time: 1.039749 Aug 28 10:31:14.384776 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 650/1274] 10.222.0.40 () {58 vars in 1272 bytes} [Sun Aug 28 10:31:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1204136317 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:31:14.710266 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-d0bc3f50-a9ba-49ae-b27f-dbd9812157eb tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:14.711407 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-d0bc3f50-a9ba-49ae-b27f-dbd9812157eb tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 7745d041-7a19-4bb0-912e-a1f0b361c559] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:14.712414 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-d27aff0a-fa0a-492c-b048-414a16d6cc4d req-07435e37-080c-41c6-9d31-940e396dfd12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7745d041-7a19-4bb0-912e-a1f0b361c559", "tag": "4e71047e-d04d-4098-862c-39240d4ddcfc"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:31:14.720586 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d0bc3f50-a9ba-49ae-b27f-dbd9812157eb tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:14.721140 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d0bc3f50-a9ba-49ae-b27f-dbd9812157eb tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:14.721642 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d0bc3f50-a9ba-49ae-b27f-dbd9812157eb tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:14.722438 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d0bc3f50-a9ba-49ae-b27f-dbd9812157eb tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:14.723034 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d0bc3f50-a9ba-49ae-b27f-dbd9812157eb tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:14.723430 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-d0bc3f50-a9ba-49ae-b27f-dbd9812157eb tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:14.731735 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-d27aff0a-fa0a-492c-b048-414a16d6cc4d req-07435e37-080c-41c6-9d31-940e396dfd12 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:14.732343 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-d27aff0a-fa0a-492c-b048-414a16d6cc4d req-07435e37-080c-41c6-9d31-940e396dfd12 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:14.732958 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-d27aff0a-fa0a-492c-b048-414a16d6cc4d req-07435e37-080c-41c6-9d31-940e396dfd12 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:14.746423 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-d27aff0a-fa0a-492c-b048-414a16d6cc4d req-07435e37-080c-41c6-9d31-940e396dfd12 service nova] Creating event network-changed:4e71047e-d04d-4098-862c-39240d4ddcfc for instance 7745d041-7a19-4bb0-912e-a1f0b361c559 on hv-cinder-85200 Aug 28 10:31:14.751741 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-d27aff0a-fa0a-492c-b048-414a16d6cc4d req-07435e37-080c-41c6-9d31-940e396dfd12 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043410 Aug 28 10:31:14.752338 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 651/1275] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 28 10:31:14.755761 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-d0bc3f50-a9ba-49ae-b27f-dbd9812157eb tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 7745d041-7a19-4bb0-912e-a1f0b361c559] Going to try to terminate instance {{(pid=120664) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 28 10:31:14.860314 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-d0bc3f50-a9ba-49ae-b27f-dbd9812157eb tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559" status: 204 len: 0 microversion: 2.1 time: 0.154114 Aug 28 10:31:14.863404 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 625/1276] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:31:14 2022] DELETE /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 28 10:31:14.873620 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-12b841d8-f200-4399-b6f6-f557fb2620ff tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:14.874630 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-12b841d8-f200-4399-b6f6-f557fb2620ff tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 7745d041-7a19-4bb0-912e-a1f0b361c559] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:14.884848 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12b841d8-f200-4399-b6f6-f557fb2620ff tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:14.885325 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12b841d8-f200-4399-b6f6-f557fb2620ff tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:14.885748 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12b841d8-f200-4399-b6f6-f557fb2620ff tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:14.886625 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12b841d8-f200-4399-b6f6-f557fb2620ff tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:14.887227 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12b841d8-f200-4399-b6f6-f557fb2620ff tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:14.887789 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12b841d8-f200-4399-b6f6-f557fb2620ff tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:15.030295 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-12b841d8-f200-4399-b6f6-f557fb2620ff tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:31:15.038575 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-12b841d8-f200-4399-b6f6-f557fb2620ff tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559" status: 200 len: 1575 microversion: 2.1 time: 0.170305 Aug 28 10:31:15.039281 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 652/1277] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:31:14 2022] GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:31:16.060721 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-4b0cda0b-10bd-4d7c-8b8b-64c11fbca52a tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:16.062319 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-4b0cda0b-10bd-4d7c-8b8b-64c11fbca52a tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 7745d041-7a19-4bb0-912e-a1f0b361c559] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:16.069805 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4b0cda0b-10bd-4d7c-8b8b-64c11fbca52a tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:16.070686 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4b0cda0b-10bd-4d7c-8b8b-64c11fbca52a tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:16.071334 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4b0cda0b-10bd-4d7c-8b8b-64c11fbca52a tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:16.072522 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4b0cda0b-10bd-4d7c-8b8b-64c11fbca52a tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:16.073311 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4b0cda0b-10bd-4d7c-8b8b-64c11fbca52a tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:16.073893 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-4b0cda0b-10bd-4d7c-8b8b-64c11fbca52a tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:16.323053 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-4b0cda0b-10bd-4d7c-8b8b-64c11fbca52a tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:31:16.327266 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:16.332489 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-4b0cda0b-10bd-4d7c-8b8b-64c11fbca52a tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559" status: 200 len: 1456 microversion: 2.1 time: 0.276800 Aug 28 10:31:16.333268 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 626/1278] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:31:16 2022] GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559 => generated 1456 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:31:16.649921 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-77e5af10-e496-411d-9b2c-afbab4d7ff78 req-d689fd23-2a77-4b28-b497-0ffb68ebb83a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7745d041-7a19-4bb0-912e-a1f0b361c559", "name": "network-vif-deleted", "tag": "4e71047e-d04d-4098-862c-39240d4ddcfc"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:31:16.662600 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-77e5af10-e496-411d-9b2c-afbab4d7ff78 req-d689fd23-2a77-4b28-b497-0ffb68ebb83a service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:16.663065 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-77e5af10-e496-411d-9b2c-afbab4d7ff78 req-d689fd23-2a77-4b28-b497-0ffb68ebb83a service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:16.663477 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-77e5af10-e496-411d-9b2c-afbab4d7ff78 req-d689fd23-2a77-4b28-b497-0ffb68ebb83a service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:16.691214 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-77e5af10-e496-411d-9b2c-afbab4d7ff78 req-d689fd23-2a77-4b28-b497-0ffb68ebb83a service nova] Creating event network-vif-deleted:4e71047e-d04d-4098-862c-39240d4ddcfc for instance 7745d041-7a19-4bb0-912e-a1f0b361c559 on hv-cinder-85200 Aug 28 10:31:16.696979 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-77e5af10-e496-411d-9b2c-afbab4d7ff78 req-d689fd23-2a77-4b28-b497-0ffb68ebb83a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053006 Aug 28 10:31:16.698221 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 653/1279] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:31:17.353259 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8b62b325-0780-45a0-b0db-e5e3821b63aa tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:17.354551 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-8b62b325-0780-45a0-b0db-e5e3821b63aa tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 7745d041-7a19-4bb0-912e-a1f0b361c559] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:17.362817 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8b62b325-0780-45a0-b0db-e5e3821b63aa tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:17.363400 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8b62b325-0780-45a0-b0db-e5e3821b63aa tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:17.364039 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8b62b325-0780-45a0-b0db-e5e3821b63aa tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:17.364936 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8b62b325-0780-45a0-b0db-e5e3821b63aa tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:17.365750 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8b62b325-0780-45a0-b0db-e5e3821b63aa tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:17.366191 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8b62b325-0780-45a0-b0db-e5e3821b63aa tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:17.400552 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8b62b325-0780-45a0-b0db-e5e3821b63aa tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:17.401242 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8b62b325-0780-45a0-b0db-e5e3821b63aa tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:17.401859 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8b62b325-0780-45a0-b0db-e5e3821b63aa tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:17.402650 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.objects.instance [None req-8b62b325-0780-45a0-b0db-e5e3821b63aa tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lazy-loading 'fault' on Instance uuid 7745d041-7a19-4bb0-912e-a1f0b361c559 {{(pid=120664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 28 10:31:17.479584 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-8b62b325-0780-45a0-b0db-e5e3821b63aa tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3deb7adb33004f1097574470754611ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af70fccdef544a499725509ccd8c545f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:31:17.489378 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-8b62b325-0780-45a0-b0db-e5e3821b63aa tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559" status: 200 len: 1230 microversion: 2.1 time: 0.140137 Aug 28 10:31:17.490385 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 627/1280] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:31:17 2022] GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559 => generated 1230 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:31:18.512986 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4353f143-b8b5-4826-8b62-c0d1c0bc8300 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:18.513808 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4353f143-b8b5-4826-8b62-c0d1c0bc8300 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 7745d041-7a19-4bb0-912e-a1f0b361c559] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:18.520033 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4353f143-b8b5-4826-8b62-c0d1c0bc8300 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:18.520529 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4353f143-b8b5-4826-8b62-c0d1c0bc8300 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:18.520973 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4353f143-b8b5-4826-8b62-c0d1c0bc8300 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:18.521682 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4353f143-b8b5-4826-8b62-c0d1c0bc8300 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:18.522104 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4353f143-b8b5-4826-8b62-c0d1c0bc8300 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:18.522529 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4353f143-b8b5-4826-8b62-c0d1c0bc8300 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:18.536213 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-4353f143-b8b5-4826-8b62-c0d1c0bc8300 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] HTTP exception thrown: Instance 7745d041-7a19-4bb0-912e-a1f0b361c559 could not be found. Aug 28 10:31:18.537893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4353f143-b8b5-4826-8b62-c0d1c0bc8300 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Request method failure captured: Aug 28 10:31:18.537893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559 HTTP/1.1 Aug 28 10:31:18.537893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:31:18.537893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:31:18.537893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:31:18.537893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:31:18.537893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:31:18.537893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:31:18.537893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:31:18.537893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:31:18.537893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0HTQZUOEwO5Qxo8TKaE1k29hFxRdBVXdLf-FAAa9VAs64CflXSgjlm6gvIGeVncZ1GkZbGZeCyoZzZmQ1FfLUjGWbMtylqhLcOqeawFD5n9A_b9VuahU95qV4H-g4QOhKuFk93vAeakTA71WUCg7U3WEYRUaup3HOfv9A9GZp6EkOA Aug 28 10:31:18.537893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:31:18.537893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:31:18.537893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:31:18.537893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:31:18.537893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:31:18.537893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:31:18.537893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: af70fccdef544a499725509ccd8c545f Aug 28 10:31:18.537893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-TestVolumeBootPattern-1181474048 Aug 28 10:31:18.537893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:31:18.537893 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:31:18.539715 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af70fccdef544a499725509ccd8c545f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af70fccdef544a499725509ccd8c545f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af70fccdef544a499725509ccd8c545f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af70fccdef544a499725509ccd8c545f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:31:18.539715 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-TestVolumeBootPattern-1181474048 Aug 28 10:31:18.539715 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: af70fccdef544a499725509ccd8c545f Aug 28 10:31:18.539715 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-TestVolumeBootPattern-1181474048 Aug 28 10:31:18.539715 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-TestVolumeBootPattern-1181474048-project Aug 28 10:31:18.539715 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:31:18.539715 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:31:18.539715 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: 3deb7adb33004f1097574470754611ec Aug 28 10:31:18.539715 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-TestVolumeBootPattern-1181474048-project Aug 28 10:31:18.539715 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: > Aug 28 10:31:18.539715 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Instance 7745d041-7a19-4bb0-912e-a1f0b361c559 could not be found. Aug 28 10:31:18.539715 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '7745d041-7a19-4bb0-912e-a1f0b361c559'} Aug 28 10:31:18.540734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:31:18.540734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:31:18.540734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:31:18.540734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:31:18.540734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:31:18.540734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:31:18.540734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:31:18.540734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:31:18.540734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:31:18.540734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:31:18.540734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7745d041-7a19-4bb0-912e-a1f0b361c559 could not be found. Aug 28 10:31:18.540734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:31:18.540734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:31:18.540734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:31:18.540734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:31:18.540734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:31:18.540734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:31:18.540734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:31:18.540734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:31:18.540734 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:31:18.542109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:31:18.542109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:31:18.542109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:31:18.542109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:31:18.542109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:31:18.542109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:31:18.542109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:31:18.542109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7745d041-7a19-4bb0-912e-a1f0b361c559 could not be found. Aug 28 10:31:18.542109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:31:18.542109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:31:18.542109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:31:18.542109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:31:18.542109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:31:18.542109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:31:18.542109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:31:18.542109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:31:18.542109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7745d041-7a19-4bb0-912e-a1f0b361c559 could not be found. Aug 28 10:31:18.542109 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:31:18.543312 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4353f143-b8b5-4826-8b62-c0d1c0bc8300 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Returning 404 to user: Instance 7745d041-7a19-4bb0-912e-a1f0b361c559 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:31:18.543312 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4353f143-b8b5-4826-8b62-c0d1c0bc8300 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559" status: 404 len: 111 microversion: 2.1 time: 0.031220 Aug 28 10:31:18.543312 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 654/1281] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:31:18 2022] GET /compute/v2.1/servers/7745d041-7a19-4bb0-912e-a1f0b361c559 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:31:19.592227 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-19e96abc-7612-476c-9e7d-709f7b1f5730 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:19.592734 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-19e96abc-7612-476c-9e7d-709f7b1f5730 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:19.599685 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-19e96abc-7612-476c-9e7d-709f7b1f5730 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:19.600243 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-19e96abc-7612-476c-9e7d-709f7b1f5730 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:19.600794 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-19e96abc-7612-476c-9e7d-709f7b1f5730 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:19.601572 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-19e96abc-7612-476c-9e7d-709f7b1f5730 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:19.602083 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-19e96abc-7612-476c-9e7d-709f7b1f5730 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:19.602549 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-19e96abc-7612-476c-9e7d-709f7b1f5730 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:19.616801 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-19e96abc-7612-476c-9e7d-709f7b1f5730 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] HTTP exception thrown: Instance 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b could not be found. Aug 28 10:31:19.618532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-19e96abc-7612-476c-9e7d-709f7b1f5730 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Request method failure captured: Aug 28 10:31:19.618532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: DELETE /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b HTTP/1.1 Aug 28 10:31:19.618532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:31:19.618532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:31:19.618532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:31:19.618532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:31:19.618532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:31:19.618532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:31:19.618532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:31:19.618532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:31:19.618532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0HTQZUOEwO5Qxo8TKaE1k29hFxRdBVXdLf-FAAa9VAs64CflXSgjlm6gvIGeVncZ1GkZbGZeCyoZzZmQ1FfLUjGWbMtylqhLcOqeawFD5n9A_b9VuahU95qV4H-g4QOhKuFk93vAeakTA71WUCg7U3WEYRUaup3HOfv9A9GZp6EkOA Aug 28 10:31:19.618532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:31:19.618532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:31:19.618532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:31:19.618532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:31:19.618532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:31:19.618532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:31:19.618532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: af70fccdef544a499725509ccd8c545f Aug 28 10:31:19.618532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-TestVolumeBootPattern-1181474048 Aug 28 10:31:19.618532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:31:19.618532 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:31:19.620254 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af70fccdef544a499725509ccd8c545f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af70fccdef544a499725509ccd8c545f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af70fccdef544a499725509ccd8c545f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af70fccdef544a499725509ccd8c545f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:31:19.620254 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-TestVolumeBootPattern-1181474048 Aug 28 10:31:19.620254 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: af70fccdef544a499725509ccd8c545f Aug 28 10:31:19.620254 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-TestVolumeBootPattern-1181474048 Aug 28 10:31:19.620254 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-TestVolumeBootPattern-1181474048-project Aug 28 10:31:19.620254 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:31:19.620254 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:31:19.620254 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: 3deb7adb33004f1097574470754611ec Aug 28 10:31:19.620254 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-TestVolumeBootPattern-1181474048-project Aug 28 10:31:19.620254 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: > Aug 28 10:31:19.620254 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Instance 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b could not be found. Aug 28 10:31:19.620254 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': '2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b'} Aug 28 10:31:19.621210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:31:19.621210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:31:19.621210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:31:19.621210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:31:19.621210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:31:19.621210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:31:19.621210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:31:19.621210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:31:19.621210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:31:19.621210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:31:19.621210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b could not be found. Aug 28 10:31:19.621210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:31:19.621210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:31:19.621210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:31:19.621210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:31:19.621210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:31:19.621210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:31:19.621210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:31:19.621210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:31:19.621210 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:31:19.622765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:31:19.622765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 28 10:31:19.622765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 28 10:31:19.622765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 28 10:31:19.622765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 28 10:31:19.622765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:31:19.622765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:31:19.622765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:31:19.622765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:31:19.622765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b could not be found. Aug 28 10:31:19.622765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:31:19.622765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:31:19.622765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:31:19.622765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:31:19.622765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:31:19.622765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:31:19.622765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:31:19.622765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:31:19.622765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b could not be found. Aug 28 10:31:19.622765 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:31:19.624473 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-19e96abc-7612-476c-9e7d-709f7b1f5730 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Returning 404 to user: Instance 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:31:19.624473 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-19e96abc-7612-476c-9e7d-709f7b1f5730 tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b" status: 404 len: 111 microversion: 2.1 time: 0.031793 Aug 28 10:31:19.624473 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 628/1282] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:31:19 2022] DELETE /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 28 10:31:19.630056 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-30ad0ba1-329a-420e-bd49-63839497acff tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:19.630672 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-30ad0ba1-329a-420e-bd49-63839497acff tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] [instance: 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:31:19.638091 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30ad0ba1-329a-420e-bd49-63839497acff tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:19.638636 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30ad0ba1-329a-420e-bd49-63839497acff tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:19.639157 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30ad0ba1-329a-420e-bd49-63839497acff tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:19.639920 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30ad0ba1-329a-420e-bd49-63839497acff tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:31:19.640436 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30ad0ba1-329a-420e-bd49-63839497acff tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:31:19.640961 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30ad0ba1-329a-420e-bd49-63839497acff tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:31:19.654809 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-30ad0ba1-329a-420e-bd49-63839497acff tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] HTTP exception thrown: Instance 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b could not be found. Aug 28 10:31:19.656457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-30ad0ba1-329a-420e-bd49-63839497acff tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Request method failure captured: Aug 28 10:31:19.656457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b HTTP/1.1 Aug 28 10:31:19.656457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept: application/json Aug 28 10:31:19.656457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Aug 28 10:31:19.656457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Connection: close Aug 28 10:31:19.656457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Aug 28 10:31:19.656457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Aug 28 10:31:19.656457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.40 Aug 28 10:31:19.656457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Aug 28 10:31:19.656457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.11 Aug 28 10:31:19.656457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjC0HTQZUOEwO5Qxo8TKaE1k29hFxRdBVXdLf-FAAa9VAs64CflXSgjlm6gvIGeVncZ1GkZbGZeCyoZzZmQ1FfLUjGWbMtylqhLcOqeawFD5n9A_b9VuahU95qV4H-g4QOhKuFk93vAeakTA71WUCg7U3WEYRUaup3HOfv9A9GZp6EkOA Aug 28 10:31:19.656457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Aug 28 10:31:19.656457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Aug 28 10:31:19.656457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Aug 28 10:31:19.656457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Aug 28 10:31:19.656457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Aug 28 10:31:19.656457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Aug 28 10:31:19.656457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Id: af70fccdef544a499725509ccd8c545f Aug 28 10:31:19.656457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-TestVolumeBootPattern-1181474048 Aug 28 10:31:19.656457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Role: reader,member Aug 28 10:31:19.656457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Roles: reader,member Aug 28 10:31:19.658167 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af70fccdef544a499725509ccd8c545f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af70fccdef544a499725509ccd8c545f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af70fccdef544a499725509ccd8c545f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af70fccdef544a499725509ccd8c545f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:31:19.658167 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-TestVolumeBootPattern-1181474048 Aug 28 10:31:19.658167 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: af70fccdef544a499725509ccd8c545f Aug 28 10:31:19.658167 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-TestVolumeBootPattern-1181474048 Aug 28 10:31:19.658167 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User: tempest-TestVolumeBootPattern-1181474048-project Aug 28 10:31:19.658167 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Aug 28 10:31:19.658167 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Aug 28 10:31:19.658167 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Id: 3deb7adb33004f1097574470754611ec Aug 28 10:31:19.658167 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-TestVolumeBootPattern-1181474048-project Aug 28 10:31:19.658167 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: method: > Aug 28 10:31:19.658167 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: exception: Instance 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b could not be found. Aug 28 10:31:19.658167 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b'} Aug 28 10:31:19.659068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:31:19.659068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:31:19.659068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:31:19.659068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:31:19.659068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:31:19.659068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:31:19.659068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:31:19.659068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:31:19.659068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:31:19.659068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:31:19.659068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b could not be found. Aug 28 10:31:19.659068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:31:19.659068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:31:19.659068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:31:19.659068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:31:19.659068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:31:19.659068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:31:19.659068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:31:19.659068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:31:19.659068 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:31:19.660684 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:31:19.660684 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:31:19.660684 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:31:19.660684 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:31:19.660684 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:31:19.660684 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:31:19.660684 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:31:19.660684 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b could not be found. Aug 28 10:31:19.660684 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:31:19.660684 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:31:19.660684 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:31:19.660684 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:31:19.660684 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:31:19.660684 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:31:19.660684 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:31:19.660684 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:31:19.660684 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b could not be found. Aug 28 10:31:19.660684 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Aug 28 10:31:19.662158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-30ad0ba1-329a-420e-bd49-63839497acff tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Returning 404 to user: Instance 2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:31:19.662158 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-30ad0ba1-329a-420e-bd49-63839497acff tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b" status: 404 len: 111 microversion: 2.1 time: 0.032979 Aug 28 10:31:19.663038 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 655/1283] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:31:19 2022] GET /compute/v2.1/servers/2bcbb0fe-6aa2-4d1b-995f-7a0e8cc9c66b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:31:20.987406 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-fe839f3c-e80e-46bd-9467-b218f23d068b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] Calling method '.version_select at 0x7f7a1c5c45e0>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:31:21.013176 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-fe839f3c-e80e-46bd-9467-b218f23d068b tempest-TestVolumeBootPattern-1181474048 tempest-TestVolumeBootPattern-1181474048-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-413008888" status: 202 len: 0 microversion: 2.1 time: 0.029981 Aug 28 10:31:21.019043 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 629/1284] 10.222.0.40 () {58 vars in 1260 bytes} [Sun Aug 28 10:31:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-413008888 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 28 10:32:14.373392 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-92c34ef0-7cad-484c-bd8d-2c35159ecf7e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:32:14.373947 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-92c34ef0-7cad-484c-bd8d-2c35159ecf7e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:32:14.375262 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-e251bf26-94c0-476f-bb1c-30224c318319 req-5d377a02-e226-449e-a441-5b05025c92b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae", "tag": "39f1800c-cf09-45ec-af04-2a341650fe20"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:32:14.378016 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 28 10:32:14.378171 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: Sun Aug 28 10:32:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae (ip 10.222.0.40) !!! Aug 28 10:32:14.379344 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:14.380189 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:14.383950 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_cell1:SELECT=10 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:14.385273 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG dbcounter [-] [120664] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:14.385457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92c34ef0-7cad-484c-bd8d-2c35159ecf7e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:32:14.386208 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92c34ef0-7cad-484c-bd8d-2c35159ecf7e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:32:14.386681 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92c34ef0-7cad-484c-bd8d-2c35159ecf7e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:32:14.387428 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92c34ef0-7cad-484c-bd8d-2c35159ecf7e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:32:14.388074 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92c34ef0-7cad-484c-bd8d-2c35159ecf7e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:32:14.388582 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92c34ef0-7cad-484c-bd8d-2c35159ecf7e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:32:14.397891 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-e251bf26-94c0-476f-bb1c-30224c318319 req-5d377a02-e226-449e-a441-5b05025c92b7 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:32:14.398409 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-e251bf26-94c0-476f-bb1c-30224c318319 req-5d377a02-e226-449e-a441-5b05025c92b7 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:32:14.398996 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-e251bf26-94c0-476f-bb1c-30224c318319 req-5d377a02-e226-449e-a441-5b05025c92b7 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:32:14.411857 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-e251bf26-94c0-476f-bb1c-30224c318319 req-5d377a02-e226-449e-a441-5b05025c92b7 service nova] Creating event network-changed:39f1800c-cf09-45ec-af04-2a341650fe20 for instance 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae on hv-cinder-85200 Aug 28 10:32:14.418171 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-92c34ef0-7cad-484c-bd8d-2c35159ecf7e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 28 10:32:14.418410 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-e251bf26-94c0-476f-bb1c-30224c318319 req-5d377a02-e226-449e-a441-5b05025c92b7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047021 Aug 28 10:32:14.419181 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 630/1285] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:32:14.503457 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-92c34ef0-7cad-484c-bd8d-2c35159ecf7e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 204 len: 0 microversion: 2.1 time: 0.133864 Aug 28 10:32:14.504354 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 656/1286] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Aug 28 10:32:14 2022] DELETE /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 28 10:32:14.514245 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-fb81a7f3-991a-434b-9a05-3c0c31ecb28e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:32:14.514934 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-fb81a7f3-991a-434b-9a05-3c0c31ecb28e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:32:14.521270 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fb81a7f3-991a-434b-9a05-3c0c31ecb28e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:32:14.521737 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fb81a7f3-991a-434b-9a05-3c0c31ecb28e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:32:14.522342 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fb81a7f3-991a-434b-9a05-3c0c31ecb28e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:32:14.523209 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fb81a7f3-991a-434b-9a05-3c0c31ecb28e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:32:14.523650 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fb81a7f3-991a-434b-9a05-3c0c31ecb28e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:32:14.524258 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-fb81a7f3-991a-434b-9a05-3c0c31ecb28e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:32:14.676435 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.policy [None req-fb81a7f3-991a-434b-9a05-3c0c31ecb28e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120664) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:32:14.684554 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-fb81a7f3-991a-434b-9a05-3c0c31ecb28e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1566 microversion: 2.1 time: 0.175282 Aug 28 10:32:14.685143 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 631/1287] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:32:14 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:32:15.706372 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-29271a3a-7b08-4737-85b6-8e03701da18e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:32:15.707070 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-29271a3a-7b08-4737-85b6-8e03701da18e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:32:15.714100 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-29271a3a-7b08-4737-85b6-8e03701da18e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:32:15.714574 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-29271a3a-7b08-4737-85b6-8e03701da18e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:32:15.715003 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-29271a3a-7b08-4737-85b6-8e03701da18e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:32:15.715690 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-29271a3a-7b08-4737-85b6-8e03701da18e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:32:15.716132 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-29271a3a-7b08-4737-85b6-8e03701da18e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:32:15.716551 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-29271a3a-7b08-4737-85b6-8e03701da18e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:32:15.895631 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-29271a3a-7b08-4737-85b6-8e03701da18e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:32:15.907414 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-29271a3a-7b08-4737-85b6-8e03701da18e tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1566 microversion: 2.1 time: 0.205365 Aug 28 10:32:15.907984 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 657/1288] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:32:15 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1566 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:32:16.773008 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [req-f3c319dd-c28b-42cc-8da0-bad87f4c48ca req-559fdf3c-7e87-4e57-ba1a-fad0e4848755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae", "name": "network-vif-deleted", "tag": "39f1800c-cf09-45ec-af04-2a341650fe20"}]} {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 28 10:32:16.783384 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-f3c319dd-c28b-42cc-8da0-bad87f4c48ca req-559fdf3c-7e87-4e57-ba1a-fad0e4848755 service nova] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:32:16.783866 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-f3c319dd-c28b-42cc-8da0-bad87f4c48ca req-559fdf3c-7e87-4e57-ba1a-fad0e4848755 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:32:16.784288 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [req-f3c319dd-c28b-42cc-8da0-bad87f4c48ca req-559fdf3c-7e87-4e57-ba1a-fad0e4848755 service nova] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:32:16.796178 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.compute.server_external_events [req-f3c319dd-c28b-42cc-8da0-bad87f4c48ca req-559fdf3c-7e87-4e57-ba1a-fad0e4848755 service nova] Creating event network-vif-deleted:39f1800c-cf09-45ec-af04-2a341650fe20 for instance 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae on hv-cinder-85200 Aug 28 10:32:16.801189 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [req-f3c319dd-c28b-42cc-8da0-bad87f4c48ca req-559fdf3c-7e87-4e57-ba1a-fad0e4848755 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032007 Aug 28 10:32:16.801790 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 632/1289] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Aug 28 10:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 28 10:32:16.932704 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3b782e72-cc47-44d0-9617-44db3f94ed26 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:32:16.933706 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3b782e72-cc47-44d0-9617-44db3f94ed26 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:32:16.944768 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b782e72-cc47-44d0-9617-44db3f94ed26 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:32:16.945556 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b782e72-cc47-44d0-9617-44db3f94ed26 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:32:16.946268 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b782e72-cc47-44d0-9617-44db3f94ed26 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:32:16.947406 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b782e72-cc47-44d0-9617-44db3f94ed26 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:32:16.948161 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b782e72-cc47-44d0-9617-44db3f94ed26 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:32:16.948910 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b782e72-cc47-44d0-9617-44db3f94ed26 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:32:17.018302 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3b782e72-cc47-44d0-9617-44db3f94ed26 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6cbf7f279a4b51994ec4508be71668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805bd1eda126437d9c2997927d9da8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Aug 28 10:32:17.028554 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3b782e72-cc47-44d0-9617-44db3f94ed26 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 200 len: 1219 microversion: 2.1 time: 0.102304 Aug 28 10:32:17.029117 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 658/1290] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:32:16 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 28 10:32:18.055322 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8f3aa10f-b2ea-4d89-9771-bbc82e5246e6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '>' {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:32:18.056490 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.compute.api [None req-8f3aa10f-b2ea-4d89-9771-bbc82e5246e6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] [instance: 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae] Fetching instance by UUID {{(pid=120664) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 28 10:32:18.065713 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8f3aa10f-b2ea-4d89-9771-bbc82e5246e6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:32:18.066192 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8f3aa10f-b2ea-4d89-9771-bbc82e5246e6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:32:18.066611 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8f3aa10f-b2ea-4d89-9771-bbc82e5246e6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:32:18.067294 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8f3aa10f-b2ea-4d89-9771-bbc82e5246e6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Acquiring lock "72a19395-589c-4f4b-90cf-8b271a69d910" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 28 10:32:18.067733 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8f3aa10f-b2ea-4d89-9771-bbc82e5246e6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 28 10:32:18.068144 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG oslo_concurrency.lockutils [None req-8f3aa10f-b2ea-4d89-9771-bbc82e5246e6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Lock "72a19395-589c-4f4b-90cf-8b271a69d910" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 28 10:32:18.081567 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.wsgi [None req-8f3aa10f-b2ea-4d89-9771-bbc82e5246e6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] HTTP exception thrown: Instance 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae could not be found. Aug 28 10:32:18.083171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8f3aa10f-b2ea-4d89-9771-bbc82e5246e6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Request method failure captured: Aug 28 10:32:18.083171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: request: GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae HTTP/1.1 Aug 28 10:32:18.083171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept: application/json Aug 28 10:32:18.083171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Accept-Encoding: identity Aug 28 10:32:18.083171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Connection: close Aug 28 10:32:18.083171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Length: 0 Aug 28 10:32:18.083171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Content-Type: application/json Aug 28 10:32:18.083171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Host: 10.222.0.40 Aug 28 10:32:18.083171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: Openstack-System-Scope: None Aug 28 10:32:18.083171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: User-Agent: python-urllib3/1.26.11 Aug 28 10:32:18.083171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Auth-Token: gAAAAABjC0K-OiSdq9pfaT1Zfd5R49W-DeINLJq10qE4zRsBZWU1NmKpcWfpIDYUyujLTWqx_FjNdvaXL33nGbTX4jfc3L4-zoMzDOlSjfT_64-HzQE4GOxrcJuDCXYk0hINfdsgpqA4u1w9boXO2vrcCOCfbPyYHWOq4HdJSs5lBHFTGa-QREc Aug 28 10:32:18.083171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Id: None Aug 28 10:32:18.083171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Domain-Name: None Aug 28 10:32:18.083171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Identity-Status: Confirmed Aug 28 10:32:18.083171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Is-Admin-Project: True Aug 28 10:32:18.083171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Id: default Aug 28 10:32:18.083171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Domain-Name: Default Aug 28 10:32:18.083171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Id: 805bd1eda126437d9c2997927d9da8c3 Aug 28 10:32:18.083171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Project-Name: tempest-TestShelveInstance-1265340436 Aug 28 10:32:18.083171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Role: reader,member Aug 28 10:32:18.083171 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Roles: reader,member Aug 28 10:32:18.085015 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_805bd1eda126437d9c2997927d9da8c3", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/805bd1eda126437d9c2997927d9da8c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/805bd1eda126437d9c2997927d9da8c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/805bd1eda126437d9c2997927d9da8c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 28 10:32:18.085015 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant: tempest-TestShelveInstance-1265340436 Aug 28 10:32:18.085015 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Id: 805bd1eda126437d9c2997927d9da8c3 Aug 28 10:32:18.085015 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-Tenant-Name: tempest-TestShelveInstance-1265340436 Aug 28 10:32:18.085015 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User: tempest-TestShelveInstance-1265340436-project Aug 28 10:32:18.085015 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Id: default Aug 28 10:32:18.085015 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Domain-Name: Default Aug 28 10:32:18.085015 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Id: ec6cbf7f279a4b51994ec4508be71668 Aug 28 10:32:18.085015 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: X-User-Name: tempest-TestShelveInstance-1265340436-project Aug 28 10:32:18.085015 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: method: > Aug 28 10:32:18.085015 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: exception: Instance 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae could not be found. Aug 28 10:32:18.085015 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: action_args: {'id': '7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae'} Aug 28 10:32:18.086041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: {{(pid=120664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 28 10:32:18.086041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:32:18.086041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 28 10:32:18.086041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 28 10:32:18.086041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 28 10:32:18.086041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 28 10:32:18.086041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 28 10:32:18.086041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 28 10:32:18.086041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 28 10:32:18.086041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 28 10:32:18.086041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae could not be found. Aug 28 10:32:18.086041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:32:18.086041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:32:18.086041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:32:18.086041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:32:18.086041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:32:18.086041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:32:18.086041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 28 10:32:18.086041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 28 10:32:18.086041 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 28 10:32:18.087695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 28 10:32:18.087695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 28 10:32:18.087695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 28 10:32:18.087695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 28 10:32:18.087695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 28 10:32:18.087695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 28 10:32:18.087695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 28 10:32:18.087695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae could not be found. Aug 28 10:32:18.087695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:32:18.087695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 28 10:32:18.087695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:32:18.087695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 28 10:32:18.087695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 28 10:32:18.087695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 28 10:32:18.087695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 28 10:32:18.087695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 28 10:32:18.087695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae could not be found. Aug 28 10:32:18.087695 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: ERROR nova.api.openstack.wsgi Aug 28 10:32:18.089213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: DEBUG nova.api.openstack.wsgi [None req-8f3aa10f-b2ea-4d89-9771-bbc82e5246e6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Returning 404 to user: Instance 7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae could not be found. {{(pid=120664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 28 10:32:18.089213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: INFO nova.api.openstack.requestlog [None req-8f3aa10f-b2ea-4d89-9771-bbc82e5246e6 tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae" status: 404 len: 111 microversion: 2.1 time: 0.037182 Aug 28 10:32:18.089213 dv-cinder-852009-4-iscsi devstack@n-api.service[120664]: [pid: 120664|app: 0|req: 633/1291] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Aug 28 10:32:18 2022] GET /compute/v2.1/servers/7cc8d5a4-d36c-4bd3-ae3f-5fc1e5a65fae => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 28 10:32:18.263269 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cb6d265f-8d0d-4502-a9f3-180a6830d1ff tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] Calling method '.version_select at 0x7f7a1c198550>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 28 10:32:18.291549 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cb6d265f-8d0d-4502-a9f3-180a6830d1ff tempest-TestShelveInstance-1265340436 tempest-TestShelveInstance-1265340436-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1279465123" status: 202 len: 0 microversion: 2.1 time: 0.032127 Aug 28 10:32:18.292208 dv-cinder-852009-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 659/1292] 10.222.0.40 () {58 vars in 1254 bytes} [Sun Aug 28 10:32:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1279465123 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)